Nov 05 03:35:48 devstack cinder-volume[76013]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 03:35:48 devstack cinder-volume[76013]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 03:35:48 devstack cinder-volume[76013]: we strongly recommend against using it for new projects. Nov 05 03:35:48 devstack cinder-volume[76013]: If you are already using Eventlet, we recommend migrating to a different Nov 05 03:35:48 devstack cinder-volume[76013]: framework. For more detail see Nov 05 03:35:48 devstack cinder-volume[76013]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 03:35:48 devstack cinder-volume[76013]: import eventlet # noqa Nov 05 03:35:51 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:35:51 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:35:51 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:35:52 devstack cinder-volume[76013]: INFO dbcounter [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Registered counter for database cinder Nov 05 03:35:52 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-d78e3205-3435-495f-b494-78c90070e59b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:52 devstack cinder-volume[76013]: DEBUG dbcounter [-] [76013] Writer thread running {{(pid=76013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:35:52 devstack cinder-volume[76013]: INFO cinder.rpc [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 03:35:52 devstack cinder-volume[76013]: INFO cinder.rpc [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 03:35:52 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-d78e3205-3435-495f-b494-78c90070e59b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:52 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Determined volume DB was empty at startup. Nov 05 03:35:52 devstack cinder-volume[76013]: DEBUG cinder.volume.manager [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76013) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Nov 05 03:35:52 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 03:35:52 devstack cinder-volume[76013]: WARNING stevedore.named [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 03:35:52 devstack cinder-volume[76013]: WARNING castellan.key_manager [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:35:52 devstack cinder-volume[76013]: WARNING cinder.keymgr.conf_key_mgr [None req-d78e3205-3435-495f-b494-78c90070e59b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:35:52 devstack cinder-volume[76013]: DEBUG cinder.volume.drivers.lvm [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76013) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 03:35:52 devstack cinder-volume[76013]: DEBUG oslo_concurrency.processutils [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_concurrency.processutils [None req-d78e3205-3435-495f-b494-78c90070e59b None None] CMD "cinder-rtstool verify" returned: 0 in 0.433s {{(pid=76013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-d78e3205-3435-495f-b494-78c90070e59b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:53 devstack cinder-volume[76013]: INFO cinder.rpc [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 03:35:53 devstack cinder-volume[76013]: INFO cinder.rpc [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version. Nov 05 03:35:53 devstack cinder-volume[76013]: WARNING stevedore.named [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 03:35:53 devstack cinder-volume[76013]: WARNING castellan.key_manager [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:35:53 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-d78e3205-3435-495f-b494-78c90070e59b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:53 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Starting 1 workers Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Started child 76183 {{(pid=76013) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Full set of CONF: {{(pid=76013) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] ******************************************************************************** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Configuration options gathered from: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] ================================================================================ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] allow_availability_zone_fallback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] allow_compression_on_image_upload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] allowed_direct_url_schemes = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] api_rate_limit = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] auth_strategy = keystone {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] az_cache_duration = 3600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_host = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_stats_polling_interval = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backup_api_class = cinder.backup.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backup_name_template = backup-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backup_use_same_host = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backup_use_temp_snapshot = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] changed_blocks_max_limit = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] changed_blocks_rpc_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] chap_username = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_internal_tenant_project_id = 5e1f6b258bd24cc2a4b25168e1c6dffb {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_internal_tenant_user_id = 088d69b4b0004959856bbfa273055950 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cloned_volume_same_az = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cluster = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] compression_format = gzip {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] compute_api_class = cinder.compute.nova.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] config_dir = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] config_source = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] control_exchange = openstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] debug = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] default_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] default_group_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] default_volume_type = lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] driver_ssl_cert_verify = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] driver_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] enable_force_upload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] enable_new_services = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] enable_unsupported_driver = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] enforce_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_api_insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_api_ssl_compression = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_ca_certificates_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_catalog_info = image:glance:publicURL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76183]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_num_retries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance_request_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] graceful_shutdown_timeout = 5 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] group_api_class = cinder.group.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] host = devstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_compress_on_upload = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_conversion_address_space_limit = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_conversion_cpu_limit = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_conversion_disable = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_upload_use_cinder_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_upload_use_internal_tenant = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_volume_cache_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_volume_cache_max_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] image_volume_cache_max_size_gb = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] init_host_max_objects_retrieval = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] instance_format = [instance: %(uuid)s] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] iscsi_target_flags = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] iscsi_write_cache = on {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] iser_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] iser_ip_address = 192.168.122.164 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] iser_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_color = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_config_append = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_options = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_rotate_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_rotate_interval_type = days {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] log_rotation_type = none {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] max_age = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] max_logfile_count = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] max_logfile_size_mb = 200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] max_over_subscription_ratio = 20.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] message_reap_interval = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] message_ttl = 2592000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] migration_create_volume_timeout_secs = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] monkey_patch = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] monkey_patch_modules = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] my_ip = 192.168.122.164 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] no_snapshot_gb_quota = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] num_iser_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] num_shell_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] num_volume_device_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] nvmeof_conn_info_version = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] nvmet_ns_id = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] nvmet_port_id = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] osapi_max_limit = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] osapi_volume_ext_list = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] osapi_volume_listen_port = 8776 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] osapi_volume_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] osapi_volume_workers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] per_volume_size_limit = -1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] periodic_fuzzy_delay = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] periodic_interval = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] public_endpoint = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] publish_errors = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] quota_backup_gigabytes = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] quota_backups = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] quota_gigabytes = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] quota_groups = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] quota_snapshots = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] quota_volumes = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] rate_limit_burst = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] rate_limit_except_level = CRITICAL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] rate_limit_interval = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] reinit_driver_count = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] report_discard_supported = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] report_interval = 120 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] reservation_clean_interval = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] reservation_expire = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] reserved_image_namespaces = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] reserved_percentage = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] rpc_response_timeout = 120 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] run_external_periodic_tasks = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] scst_target_driver = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_down_time = 720 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] shell_completion = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] snapshot_name_template = snapshot-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] snapshot_same_host = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] state_path = /opt/stack/data/cinder {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] storage_availability_zone = nova {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] storage_protocol = iSCSI {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] syslog_log_facility = LOG_USER {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] target_helper = lioadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] target_ip_address = 192.168.122.164 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] target_secondary_ip_addresses = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] transport_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] until_refresh = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] use_chap_auth = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] use_default_quota_class = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] use_journal = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] use_json = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] use_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] use_stderr = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] use_syslog = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] verify_glance_signatures = enabled {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_api_class = cinder.volume.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_clear_size = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_copy_bps_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_dd_blocksize = 1M {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_name_template = volume-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_service_inithost_offload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volume_usage_audit_period = month {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] zoning_mode = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_concurrency.disable_process_locking = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.auth_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.cache = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.include_service_catalog = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.interface = public {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcache_username = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.service_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.backend = dogpile.cache.null {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.backend_argument = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.backend_expiration_time = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.config_prefix = cache.oslo {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.debug_cache_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.enable_retry_client = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.enable_socket_keepalive = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.expiration_time = 600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.hashclient_retry_attempts = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.memcache_dead_retry = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.memcache_pool_maxsize = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.memcache_sasl_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.proxies = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.redis_db = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.redis_server = localhost:6379 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.retry_attempts = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.retry_delay = 0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.socket_keepalive_count = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.socket_keepalive_idle = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.socket_keepalive_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.socket_timeout = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.tls_allowed_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.tls_cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.tls_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.tls_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.tls_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cache.username = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] coordination.backend_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.asyncio_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.asyncio_slave_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.backend = sqlalchemy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.connection_debug = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.connection_parameters = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.connection_recycle_time = 3600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.connection_trace = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.db_inc_retry_interval = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.db_max_retries = 20 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.db_max_retry_interval = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.db_retry_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.max_overflow = 50 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.max_pool_size = 5 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.max_retries = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.mysql_wsrep_sync_wait = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.pool_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.retry_interval = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.slave_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.sqlite_synchronous = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.synchronous_reader = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] database.use_db_reconnect = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_tracing.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.connection_string = messaging:// {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.es_doc_type = notification {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.es_scroll_size = 10000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.es_scroll_time = 2m {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.filter_error_trace = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.hmac_keys = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.sentinel_service_name = mymaster {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.socket_timeout = 0.1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.trace_requests = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler.trace_sqlalchemy = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler_jaeger.process_tags = {} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler_jaeger.service_name_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] profiler_otlp.service_name_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.enforce_new_defaults = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.policy_default_rule = default {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.policy_file = policy.yaml {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] privsep_osbrick.group = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] privsep_osbrick.helper_command = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] privsep_osbrick.user = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_sys_admin.group = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_sys_admin.helper_command = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] cinder_sys_admin.user = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76183]: INFO cinder.volume.manager [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.send_service_user_token = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.tls_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] service_user.tls_min_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.tls_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] glance.tls_min_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.chap_username = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.driver_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.extra_capabilities = {} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.iscsi_target_flags = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.iscsi_write_cache = on {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.iser_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.iser_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.lvm_share_target = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.lvm_type = auto {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.num_shell_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.report_discard_supported = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.reserved_percentage = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.target_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.unique_fqdn_network = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.use_chap_auth = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_clear_size = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_reports.file_event_handler = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_reports.log_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.backend_host = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.chap_username = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.extra_capabilities = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.iser_helper = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.iser_ip_address = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.iser_port = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.lvm_share_target = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.lvm_type = auto {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.num_shell_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.report_discard_supported = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.reserved_percentage = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.scst_target_driver = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.storage_protocol = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.target_helper = lioadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.target_ip_address = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.use_chap_auth = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack sudo[76245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_clear_size = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack sudo[76245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] lvmdriver-1.volumes_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.070s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_notifications.driver = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_notifications.retry = -1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] key_manager.fixed_key = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.barbican_api_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.barbican_endpoint = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.barbican_endpoint_type = public {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.barbican_region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.number_of_retries = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.retry_delay = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.send_service_user_token = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.tls_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.tls_min_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.verify_ssl = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican.verify_ssl_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.auth_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.tls_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] barbican_service_user.tls_min_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.approle_role_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.approle_secret_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.auth_method = approle {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.auth_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.kv_mountpoint = secret {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.kv_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.kv_version = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.root_token_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.ssl_ca_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.token_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.token_role = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:53 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] ******************************************************************************** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 03:35:53 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:53 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:53 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:53 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:54 devstack sudo[76245]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:54 devstack sudo[76351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:54 devstack sudo[76351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:54 devstack sudo[76351]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.282s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:35:54 devstack cinder-volume[76183]: INFO cinder.brick.local_dev.lvm [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:54 devstack sudo[76451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:54 devstack sudo[76451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:54 devstack sudo[76451]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG cinder.brick.local_dev.lvm [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76183) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 03:35:54 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:54 devstack sudo[76567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:54 devstack sudo[76567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:55 devstack sudo[76567]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:55 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:55 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:55 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:55 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:55 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:55 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:55 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:55 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.407s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:55 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:55 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:55 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:55 devstack sudo[76834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 03:35:55 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:56 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:56 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.353s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:56 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:56 devstack sudo[76921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:56 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:56 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:56 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:56 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:56 devstack sudo[76924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:56 devstack sudo[76924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:56 devstack sudo[76924]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:56 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:56 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:56 devstack sudo[76962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:56 devstack sudo[76962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:57 devstack sudo[76962]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:57 devstack sudo[77016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:57 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:57 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:57 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:57 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:57 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:57 devstack cinder-volume[76183]: INFO cinder.volume.drivers.lvm [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:57 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:57 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:57 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG cinder.volume.drivers.lvm [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Updating volume stats {{(pid=76183) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:35:57 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:57 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:57 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:58 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:58 devstack sudo[77030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:58 devstack sudo[77030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:58 devstack sudo[77030]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:58 devstack sudo[77033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:58 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:58 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:58 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:58 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:58 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:58 devstack cinder-volume[76183]: INFO cinder.volume.driver [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Driver hasn't implemented _init_vendor_properties() Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG cinder.volume.driver [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76183) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 03:35:58 devstack cinder-volume[76183]: DEBUG oslo_db.sqlalchemy.engines [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76183) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG dbcounter [-] [76183] Writer thread running {{(pid=76183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG cinder.db.api [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Building query based on filter {{(pid=76183) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}} Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG cinder.image.image_utils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76183) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 05 03:35:59 devstack cinder-volume[76183]: INFO cinder.keymgr.migration [None req-edc753f1-1b25-486c-b1a8-c075bed1f2e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG cinder.volume.drivers.lvm [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Updating volume stats {{(pid=76183) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:59 devstack sudo[77046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:59 devstack sudo[77046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:59 devstack sudo[77046]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:59 devstack sudo[77051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:59 devstack sudo[77051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:59 devstack sudo[77051]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:59 devstack sudo[77054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:59 devstack sudo[77054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:59 devstack sudo[77054]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:59 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:59 devstack sudo[77058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:59 devstack sudo[77058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:00 devstack sudo[77058]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG cinder.manager [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Notifying Schedulers of capabilities ... {{(pid=76183) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:36:00 devstack cinder-volume[76183]: INFO cinder.volume.manager [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Driver initialization completed successfully. Nov 05 03:36:00 devstack cinder-volume[76183]: INFO cinder.manager [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Initiating service 2 cleanup Nov 05 03:36:00 devstack cinder-volume[76183]: INFO cinder.manager [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Service 2 cleanup completed. Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG cinder.service [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Creating RPC server for service cinder-volume {{(pid=76183) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG cinder.service [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76183) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 03:36:00 devstack cinder-volume[76183]: INFO cinder.volume.manager [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG cinder.volume.drivers.lvm [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Updating volume stats {{(pid=76183) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:36:00 devstack sudo[77063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:36:00 devstack sudo[77063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:00 devstack sudo[77063]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:36:00 devstack sudo[77066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:36:00 devstack sudo[77066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:00 devstack sudo[77066]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:00 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:36:00 devstack sudo[77070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:36:00 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:01 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:01 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:01 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:36:01 devstack sudo[77073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:36:01 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:01 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:01 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:01 devstack cinder-volume[76183]: INFO cinder.volume.manager [None req-ea6ddff0-0533-460e-b756-ebe7c809af6e None None] Driver post RPC initialization completed successfully. Nov 05 03:36:03 devstack cinder-volume[76013]: DEBUG dbcounter [-] [76013] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:36:11 devstack cinder-volume[76183]: DEBUG dbcounter [-] [76183] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:36:11 devstack cinder-volume[76183]: DEBUG dbcounter [-] [76183] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:36:15 devstack cinder-volume[76183]: DEBUG oslo_service.periodic_task [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running periodic task VolumeManager._thread_info {{(pid=76183) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:36:15 devstack cinder-volume[76183]: DEBUG cinder.volume.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] thread count: 6 {{(pid=76183) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:36:15 devstack cinder-volume[76183]: DEBUG cinder.volume.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] thread info: [<_MainThread(MainThread, started 140483327979648)>, , , , , ] {{(pid=76183) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:37:15 devstack cinder-volume[76183]: DEBUG oslo_service.periodic_task [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76183) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:37:15 devstack cinder-volume[76183]: DEBUG cinder.volume.drivers.lvm [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Updating volume stats {{(pid=76183) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:37:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:37:15 devstack sudo[79593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:37:15 devstack sudo[79593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:37:15 devstack sudo[79593]: pam_unix(sudo:session): session closed for user root Nov 05 03:37:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:37:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:37:15 devstack sudo[79596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:37:15 devstack sudo[79596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:37:15 devstack sudo[79596]: pam_unix(sudo:session): session closed for user root Nov 05 03:37:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:37:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:37:15 devstack sudo[79599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:37:15 devstack sudo[79599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:37:16 devstack sudo[79599]: pam_unix(sudo:session): session closed for user root Nov 05 03:37:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:37:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:37:16 devstack sudo[79602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:37:16 devstack sudo[79602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:37:16 devstack sudo[79602]: pam_unix(sudo:session): session closed for user root Nov 05 03:37:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:37:16 devstack cinder-volume[76183]: DEBUG cinder.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Notifying Schedulers of capabilities ... {{(pid=76183) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:37:16 devstack cinder-volume[76183]: DEBUG oslo_service.periodic_task [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running periodic task VolumeManager._thread_info {{(pid=76183) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:37:16 devstack cinder-volume[76183]: DEBUG cinder.volume.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] thread count: 6 {{(pid=76183) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:37:16 devstack cinder-volume[76183]: DEBUG cinder.volume.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] thread info: [<_MainThread(MainThread, started 140483327979648)>, , , , , ] {{(pid=76183) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:38:11 devstack cinder-volume[76183]: DEBUG dbcounter [-] [76183] Writing DB stats cinder:SELECT=1 {{(pid=76183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:38:11 devstack cinder-volume[76183]: DEBUG dbcounter [-] [76183] Writing DB stats cinder:UPDATE=1 {{(pid=76183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:38:15 devstack cinder-volume[76183]: DEBUG oslo_service.periodic_task [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76183) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:38:15 devstack cinder-volume[76183]: DEBUG cinder.volume.drivers.lvm [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Updating volume stats {{(pid=76183) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:38:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:38:15 devstack sudo[82626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:38:15 devstack sudo[82626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:38:15 devstack sudo[82626]: pam_unix(sudo:session): session closed for user root Nov 05 03:38:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:38:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:38:15 devstack sudo[82629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:38:15 devstack sudo[82629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:38:15 devstack sudo[82629]: pam_unix(sudo:session): session closed for user root Nov 05 03:38:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:38:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:38:15 devstack sudo[82632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:38:15 devstack sudo[82632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:38:16 devstack sudo[82632]: pam_unix(sudo:session): session closed for user root Nov 05 03:38:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:38:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:38:16 devstack sudo[82635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:38:16 devstack sudo[82635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:38:16 devstack sudo[82635]: pam_unix(sudo:session): session closed for user root Nov 05 03:38:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:38:16 devstack cinder-volume[76183]: DEBUG cinder.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Notifying Schedulers of capabilities ... {{(pid=76183) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:38:16 devstack cinder-volume[76183]: DEBUG oslo_service.periodic_task [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running periodic task VolumeManager._thread_info {{(pid=76183) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:38:16 devstack cinder-volume[76183]: DEBUG cinder.volume.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] thread count: 6 {{(pid=76183) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:38:16 devstack cinder-volume[76183]: DEBUG cinder.volume.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] thread info: [<_MainThread(MainThread, started 140483327979648)>, , , , , ] {{(pid=76183) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:39:15 devstack cinder-volume[76183]: DEBUG oslo_service.periodic_task [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76183) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:39:15 devstack cinder-volume[76183]: DEBUG cinder.volume.drivers.lvm [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Updating volume stats {{(pid=76183) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:39:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:39:15 devstack sudo[84938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:39:15 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:39:15 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root Nov 05 03:39:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:39:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:39:15 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:39:15 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:39:15 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Nov 05 03:39:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:39:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:39:15 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:39:15 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:39:16 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Nov 05 03:39:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:39:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:39:16 devstack sudo[84962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:39:16 devstack sudo[84962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:39:16 devstack sudo[84962]: pam_unix(sudo:session): session closed for user root Nov 05 03:39:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:39:16 devstack cinder-volume[76183]: DEBUG cinder.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Notifying Schedulers of capabilities ... {{(pid=76183) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:39:16 devstack cinder-volume[76183]: DEBUG oslo_service.periodic_task [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running periodic task VolumeManager._thread_info {{(pid=76183) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:39:16 devstack cinder-volume[76183]: DEBUG cinder.volume.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] thread count: 6 {{(pid=76183) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:39:16 devstack cinder-volume[76183]: DEBUG cinder.volume.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] thread info: [<_MainThread(MainThread, started 140483327979648)>, , , , , ] {{(pid=76183) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:40:11 devstack cinder-volume[76183]: DEBUG dbcounter [-] [76183] Writing DB stats cinder:SELECT=1 {{(pid=76183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:40:11 devstack cinder-volume[76183]: DEBUG dbcounter [-] [76183] Writing DB stats cinder:UPDATE=1 {{(pid=76183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:40:15 devstack cinder-volume[76183]: DEBUG oslo_service.periodic_task [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76183) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:40:15 devstack cinder-volume[76183]: DEBUG cinder.volume.drivers.lvm [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Updating volume stats {{(pid=76183) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:40:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:15 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:40:15 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:15 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:15 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:40:15 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:15 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:15 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:15 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:40:15 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:16 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:16 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:40:16 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:16 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:16 devstack cinder-volume[76183]: DEBUG oslo_concurrency.processutils [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76183) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:16 devstack cinder-volume[76183]: DEBUG cinder.manager [None req-2932ddcc-7808-4e43-9a4f-318cca9e1637 None None] Notifying Schedulers of capabilities ... {{(pid=76183) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:40:18 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Caught SIGTERM, stopping children Nov 05 03:40:18 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Acquiring lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:18 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Acquired lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:18 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Releasing lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:18 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Stop services. {{(pid=76013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 03:40:18 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Killing children. {{(pid=76013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 03:40:18 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Waiting on 1 children to exit Nov 05 03:40:20 devstack cinder-volume[76183]: DEBUG oslo_concurrency.lockutils [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Acquiring lock "singleton_lock" {{(pid=76183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:20 devstack cinder-volume[76183]: DEBUG oslo_concurrency.lockutils [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Acquired lock "singleton_lock" {{(pid=76183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:20 devstack cinder-volume[76183]: DEBUG oslo_concurrency.lockutils [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Releasing lock "singleton_lock" {{(pid=76183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:20 devstack cinder-volume[76183]: WARNING amqp [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 03:40:20 devstack cinder-volume[76183]: WARNING amqp [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 03:40:20 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-d78e3205-3435-495f-b494-78c90070e59b None None] Child 76183 exited with status 0 Nov 05 03:40:20 devstack cinder-volume[86280]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 03:40:20 devstack cinder-volume[86280]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 03:40:20 devstack cinder-volume[86280]: we strongly recommend against using it for new projects. Nov 05 03:40:20 devstack cinder-volume[86280]: If you are already using Eventlet, we recommend migrating to a different Nov 05 03:40:20 devstack cinder-volume[86280]: framework. For more detail see Nov 05 03:40:20 devstack cinder-volume[86280]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 03:40:20 devstack cinder-volume[86280]: import eventlet # noqa Nov 05 03:40:22 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:22 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:22 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:23 devstack cinder-volume[86280]: INFO dbcounter [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Registered counter for database cinder Nov 05 03:40:23 devstack cinder-volume[86280]: DEBUG oslo_db.sqlalchemy.engines [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:23 devstack cinder-volume[86280]: DEBUG dbcounter [-] [86280] Writer thread running {{(pid=86280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:40:23 devstack cinder-volume[86280]: INFO cinder.rpc [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 03:40:23 devstack cinder-volume[86280]: INFO cinder.rpc [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 03:40:23 devstack cinder-volume[86280]: DEBUG oslo_db.sqlalchemy.engines [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:23 devstack cinder-volume[86280]: INFO cinder.volume.manager [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Determined volume DB was empty at startup. Nov 05 03:40:23 devstack cinder-volume[86280]: DEBUG cinder.volume.manager [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86280) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Nov 05 03:40:23 devstack cinder-volume[86280]: INFO cinder.volume.manager [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 03:40:23 devstack cinder-volume[86280]: WARNING stevedore.named [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 03:40:23 devstack cinder-volume[86280]: WARNING castellan.key_manager [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:40:23 devstack cinder-volume[86280]: WARNING cinder.keymgr.conf_key_mgr [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:40:24 devstack cinder-volume[86280]: INFO cinder.volume.manager [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_db.sqlalchemy.engines [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:24 devstack cinder-volume[86280]: INFO oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Starting 1 workers Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Started child 86499 {{(pid=86280) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Full set of CONF: {{(pid=86280) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] ******************************************************************************** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Configuration options gathered from: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] ================================================================================ {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] allow_availability_zone_fallback = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] allow_compression_on_image_upload = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] allowed_direct_url_schemes = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86499]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] api_rate_limit = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] auth_strategy = keystone {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_availability_zone = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_host = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_stats_polling_interval = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backup_api_class = cinder.backup.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backup_name_template = backup-%s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backup_use_same_host = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backup_use_temp_snapshot = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] changed_blocks_max_limit = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] changed_blocks_rpc_timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] chap_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] chap_username = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_internal_tenant_project_id = 5e1f6b258bd24cc2a4b25168e1c6dffb {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_internal_tenant_user_id = 088d69b4b0004959856bbfa273055950 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cluster = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] compression_format = gzip {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] compute_api_class = cinder.compute.nova.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] config_dir = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] config_source = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] control_exchange = openstack {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] debug = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] default_availability_zone = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] default_group_type = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] default_volume_type = QuobyteHD {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] disk_geometry = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] driver_client_cert = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] driver_client_cert_key = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] driver_data_namespace = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] driver_ssl_cert_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] driver_ssl_cert_verify = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] driver_use_ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] enable_new_services = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] enable_unsupported_driver = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] enabled_backends = ['QuobyteHD'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] enforce_multipath_for_image_xfer = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] filter_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_api_insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_api_ssl_compression = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_ca_certificates_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_catalog_info = image:glance:publicURL {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_num_retries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance_request_timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] goodness_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] graceful_shutdown_timeout = 5 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] group_api_class = cinder.group.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] host = devstack {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_compress_on_upload = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_conversion_address_space_limit = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_conversion_cpu_limit = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_conversion_disable = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_upload_use_cinder_backend = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_upload_use_internal_tenant = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_volume_cache_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_volume_cache_max_count = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] image_volume_cache_max_size_gb = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] init_host_max_objects_retrieval = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] instance_format = [instance: %(uuid)s] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86499]: INFO cinder.volume.manager [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Starting volume driver QuobyteDriver (1.2) Nov 05 03:40:24 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.remotefs [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86499) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] iscsi_target_flags = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] iscsi_write_cache = on {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] iser_helper = tgtadm {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] iser_ip_address = 192.168.122.164 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] iser_port = 3260 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_color = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_config_append = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_dir = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_options = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_rotate_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_rotate_interval_type = days {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] log_rotation_type = none {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] max_age = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] max_logfile_count = 30 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] max_logfile_size_mb = 200 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] max_over_subscription_ratio = 20.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] message_reap_interval = 86400 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] message_ttl = 2592000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] migration_create_volume_timeout_secs = 300 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] monkey_patch = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] monkey_patch_modules = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] my_ip = 192.168.122.164 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] no_snapshot_gb_quota = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] num_iser_scan_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] num_shell_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] num_volume_device_scan_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] nvmeof_conn_info_version = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] nvmet_ns_id = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] nvmet_port_id = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] osapi_max_limit = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] osapi_volume_ext_list = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] osapi_volume_listen_port = 8776 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] osapi_volume_use_ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] osapi_volume_workers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] per_volume_size_limit = -1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] periodic_fuzzy_delay = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] periodic_interval = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] public_endpoint = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] publish_errors = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] quota_backup_gigabytes = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] quota_backups = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] quota_gigabytes = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] quota_groups = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] quota_snapshots = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] quota_volumes = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] rate_limit_burst = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] rate_limit_except_level = CRITICAL {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] rate_limit_interval = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] reinit_driver_count = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] replication_device = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] report_discard_supported = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] report_interval = 120 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] reservation_clean_interval = 86400 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] reservation_expire = 86400 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] reserved_image_namespaces = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] reserved_percentage = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] rpc_response_timeout = 120 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] run_external_periodic_tasks = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] scst_target_driver = iscsi {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] scst_target_iqn_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_down_time = 720 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] shell_completion = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] snapshot_name_template = snapshot-%s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] state_path = /opt/stack/data/cinder {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] storage_availability_zone = nova {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] storage_protocol = iSCSI {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] syslog_log_facility = LOG_USER {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] target_helper = lioadm {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] target_ip_address = 192.168.122.164 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] target_port = 3260 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] target_protocol = iscsi {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] target_secondary_ip_addresses = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] trace_flags = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] transport_url = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] until_refresh = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] use_chap_auth = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] use_default_quota_class = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] use_journal = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] use_json = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] use_multipath_for_image_xfer = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] use_stderr = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] use_syslog = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] verify_glance_signatures = enabled {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_api_class = cinder.volume.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_backend_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_clear = zero {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_clear_ionice = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_clear_size = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_copy_bps_limit = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_dd_blocksize = 1M {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_name_template = volume-%s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_service_inithost_offload = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volume_usage_audit_period = month {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] zoning_mode = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_concurrency.disable_process_locking = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.auth_section = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.auth_type = password {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.auth_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.cache = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.include_service_catalog = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.interface = public {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86499) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Nov 05 03:40:24 devstack cinder-volume[86499]: WARNING cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 03:40:24 devstack cinder-volume[86499]: WARNING cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Running cmd (subprocess): mount.quobyte {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcache_username = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.region_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.service_type = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.backend = dogpile.cache.null {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.backend_argument = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.backend_expiration_time = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.config_prefix = cache.oslo {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.debug_cache_backend = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.enable_retry_client = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.enable_socket_keepalive = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.expiration_time = 600 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.hashclient_retry_attempts = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.memcache_dead_retry = 300 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.memcache_pool_maxsize = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.memcache_sasl_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.proxies = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.redis_db = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.redis_server = localhost:6379 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.retry_attempts = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.retry_delay = 0.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.socket_keepalive_count = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.socket_keepalive_idle = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.socket_keepalive_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.socket_timeout = 1.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.tls_allowed_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.tls_cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.tls_certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.tls_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.tls_keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cache.username = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] coordination.backend_url = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.asyncio_connection = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.asyncio_slave_connection = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.backend = sqlalchemy {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.connection = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.connection_debug = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.connection_parameters = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.connection_recycle_time = 3600 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.connection_trace = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.db_inc_retry_interval = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.db_max_retries = 20 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.db_max_retry_interval = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.db_retry_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.max_overflow = 50 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.max_pool_size = 5 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.max_retries = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.mysql_wsrep_sync_wait = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.pool_timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.retry_interval = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.slave_connection = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.sqlite_synchronous = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.synchronous_reader = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] database.use_db_reconnect = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_tracing.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.connection_string = messaging:// {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.es_doc_type = notification {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.es_scroll_size = 10000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.es_scroll_time = 2m {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.filter_error_trace = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.hmac_keys = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.sentinel_service_name = mymaster {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.socket_timeout = 0.1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.trace_requests = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler.trace_sqlalchemy = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler_jaeger.process_tags = {} {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler_jaeger.service_name_prefix = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] profiler_otlp.service_name_prefix = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.enforce_new_defaults = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.policy_default_rule = default {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.policy_file = policy.yaml {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] privsep_osbrick.group = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] privsep_osbrick.helper_command = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] privsep_osbrick.user = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_sys_admin.group = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_sys_admin.helper_command = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] cinder_sys_admin.user = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.auth_section = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.auth_type = password {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.collect_timing = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.send_service_user_token = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.tls_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] service_user.tls_min_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.auth_section = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.auth_type = password {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.collect_timing = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.region_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.tls_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] glance.tls_min_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.backend_availability_zone = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.chap_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.chap_username = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.disk_geometry = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.driver_client_cert = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.driver_client_cert_key = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.driver_data_namespace = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.driver_use_ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.extra_capabilities = {} {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.filter_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.goodness_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.iscsi_target_flags = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.iscsi_write_cache = on {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.iser_helper = tgtadm {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.iser_port = 3260 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_host = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_login = admin {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_mount_options = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_private_key = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_share_path = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.num_shell_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] CMD "mount.quobyte" returned: 1 in 0.131s {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:24 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.quobyte_volume_url = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.replication_device = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.report_discard_supported = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.reserved_percentage = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:24 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=86499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:24 devstack cinder-volume[86499]: INFO cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 ... Nov 05 03:40:24 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 -c /etc/quobyte/client-cinder.cfg {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.target_helper = tgtadm {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.target_port = 3260 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.target_protocol = iscsi {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.trace_flags = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.unique_fqdn_network = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.use_chap_auth = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volume_backend_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volume_clear = zero {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volume_clear_ionice = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volume_clear_size = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_reports.file_event_handler = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_reports.log_dir = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.backend_availability_zone = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.backend_host = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.chap_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.chap_username = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.chiscsi_conf = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.disk_geometry = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.driver_client_cert = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.driver_data_namespace = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.driver_use_ssl = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 -c /etc/quobyte/client-cinder.cfg Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.extra_capabilities = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.filter_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.goodness_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.iser_helper = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.iser_ip_address = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.iser_port = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.iser_target_prefix = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_host = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_login = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_mount_options = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_private_key = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_share_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_ssh_port = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.num_shell_tries = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.nvmet_port_id = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.replication_device = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.report_discard_supported = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.reserved_percentage = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.scst_target_driver = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.storage_protocol = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.target_helper = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.target_ip_address = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.target_port = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.target_prefix = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.target_protocol = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.trace_flags = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.use_chap_auth = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volume_clear = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volume_clear_size = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] QuobyteHD.volumes_dir = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_notifications.driver = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_notifications.retry = -1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] key_manager.fixed_key = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.barbican_api_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.barbican_endpoint = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.barbican_endpoint_type = public {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.barbican_region_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.collect_timing = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.number_of_retries = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.retry_delay = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.send_service_user_token = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.tls_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.tls_min_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.verify_ssl = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican.verify_ssl_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.auth_section = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.auth_type = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.collect_timing = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.tls_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] barbican_service_user.tls_min_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.approle_role_id = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.approle_secret_id = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.auth_method = approle {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.auth_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.kv_mountpoint = secret {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.kv_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.kv_version = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.namespace = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.root_token_id = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.ssl_ca_crt_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.timeout = 60.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.token_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.token_role = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.use_ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:24 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] ******************************************************************************** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 03:40:25 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.521s {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:25 devstack cinder-volume[86499]: INFO cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 succeeded Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=86499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.532s {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:25 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:40:25 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:25 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.242s {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:25 devstack cinder-volume[86499]: INFO cinder.volume.driver [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Driver hasn't implemented _init_vendor_properties() Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.volume.driver [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86499) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_db.sqlalchemy.engines [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG dbcounter [-] [86499] Writer thread running {{(pid=86499) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.db.api [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Building query based on filter {{(pid=86499) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.image.image_utils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86499) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 05 03:40:25 devstack cinder-volume[86499]: INFO cinder.keymgr.migration [None req-1f6bfae8-699f-4080-b669-a3c86af07b14 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=86499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=86499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:25 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:40:25 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:25 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.395s {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.manager [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Notifying Schedulers of capabilities ... {{(pid=86499) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:40:25 devstack cinder-volume[86499]: INFO cinder.volume.manager [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Driver initialization completed successfully. Nov 05 03:40:25 devstack cinder-volume[86499]: INFO cinder.manager [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Initiating service 3 cleanup Nov 05 03:40:25 devstack cinder-volume[86499]: INFO cinder.manager [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Service 3 cleanup completed. Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.service [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Creating RPC server for service cinder-volume {{(pid=86499) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 03:40:25 devstack cinder-volume[86499]: DEBUG cinder.service [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86499) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 03:40:26 devstack cinder-volume[86499]: INFO cinder.volume.manager [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Nov 05 03:40:26 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:26 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:26 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=86499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:26 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=86499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:26 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:26 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:26 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:40:26 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:26 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:26 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.384s {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:26 devstack cinder-volume[86499]: INFO cinder.volume.manager [None req-b033dd63-4b12-41ae-8da9-ff469066edbd None None] Driver post RPC initialization completed successfully. Nov 05 03:40:29 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-5ddd96a2-e71a-4c77-bf54-a6a525aa1ded None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:29 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-5ddd96a2-e71a-4c77-bf54-a6a525aa1ded None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:29 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd96a2-e71a-4c77-bf54-a6a525aa1ded None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=86499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:29 devstack cinder-volume[86499]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd96a2-e71a-4c77-bf54-a6a525aa1ded None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=86499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:29 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-5ddd96a2-e71a-4c77-bf54-a6a525aa1ded None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:29 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-5ddd96a2-e71a-4c77-bf54-a6a525aa1ded None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:29 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:40:29 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:29 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:29 devstack cinder-volume[86499]: DEBUG oslo_concurrency.processutils [None req-5ddd96a2-e71a-4c77-bf54-a6a525aa1ded None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.242s {{(pid=86499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:29 devstack cinder-volume[86499]: DEBUG cinder.manager [None req-5ddd96a2-e71a-4c77-bf54-a6a525aa1ded None None] Notifying Schedulers of capabilities ... {{(pid=86499) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:40:31 devstack cinder-volume[86280]: INFO oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Caught SIGTERM, stopping children Nov 05 03:40:31 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Acquiring lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:31 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Acquired lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:31 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Releasing lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:31 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Stop services. {{(pid=86280) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 03:40:31 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Killing children. {{(pid=86280) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 03:40:31 devstack cinder-volume[86280]: INFO oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Waiting on 1 children to exit Nov 05 03:40:34 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Acquiring lock "singleton_lock" {{(pid=86499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:34 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Acquired lock "singleton_lock" {{(pid=86499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:34 devstack cinder-volume[86499]: DEBUG oslo_concurrency.lockutils [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Releasing lock "singleton_lock" {{(pid=86499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:34 devstack cinder-volume[86499]: WARNING amqp [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 03:40:34 devstack cinder-volume[86499]: WARNING amqp [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 03:40:34 devstack cinder-volume[86280]: INFO oslo_service.backend._eventlet.service [None req-43a6cec8-0871-4ca2-ab99-4ab2e3200a8a None None] Child 86499 exited with status 0 Nov 05 03:40:35 devstack cinder-volume[86815]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 03:40:35 devstack cinder-volume[86815]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 03:40:35 devstack cinder-volume[86815]: we strongly recommend against using it for new projects. Nov 05 03:40:35 devstack cinder-volume[86815]: If you are already using Eventlet, we recommend migrating to a different Nov 05 03:40:35 devstack cinder-volume[86815]: framework. For more detail see Nov 05 03:40:35 devstack cinder-volume[86815]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 03:40:35 devstack cinder-volume[86815]: import eventlet # noqa Nov 05 03:40:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:39 devstack cinder-volume[86815]: INFO dbcounter [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Registered counter for database cinder Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writer thread running {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:40:39 devstack cinder-volume[86815]: INFO cinder.rpc [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 03:40:39 devstack cinder-volume[86815]: INFO cinder.rpc [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:39 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Determined volume DB was empty at startup. Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86815) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Nov 05 03:40:39 devstack cinder-volume[86815]: WARNING stevedore.named [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 03:40:39 devstack cinder-volume[86815]: WARNING castellan.key_manager [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:40:39 devstack cinder-volume[86815]: WARNING cinder.keymgr.conf_key_mgr [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:40:39 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:39 devstack cinder-volume[86815]: INFO oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Starting 1 workers Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Started child 87111 {{(pid=86815) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Full set of CONF: {{(pid=86815) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] ******************************************************************************** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] Configuration options gathered from: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] ================================================================================ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 03:40:39 devstack cinder-volume[87111]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] allow_availability_zone_fallback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] allow_compression_on_image_upload = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] allowed_direct_url_schemes = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] api_rate_limit = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] auth_strategy = keystone {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_stats_polling_interval = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backup_api_class = cinder.backup.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backup_name_template = backup-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backup_use_same_host = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backup_use_temp_snapshot = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] changed_blocks_max_limit = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] changed_blocks_rpc_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] chap_username = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_internal_tenant_project_id = 5e1f6b258bd24cc2a4b25168e1c6dffb {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_internal_tenant_user_id = 088d69b4b0004959856bbfa273055950 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cluster = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] compression_format = gzip {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] compute_api_class = cinder.compute.nova.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] config_dir = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] config_source = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] control_exchange = openstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] debug = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] default_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] default_group_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] default_volume_type = QuobyteHD {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] driver_ssl_cert_verify = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] driver_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] enable_new_services = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] enable_unsupported_driver = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] enabled_backends = ['QuobyteHD'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] enforce_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_api_insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_api_servers = ['http://192.168.122.164/image'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_api_ssl_compression = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_ca_certificates_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_catalog_info = image:glance:publicURL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_num_retries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance_request_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] graceful_shutdown_timeout = 5 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] group_api_class = cinder.group.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] host = devstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_compress_on_upload = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_conversion_address_space_limit = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_conversion_cpu_limit = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_conversion_disable = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_upload_use_cinder_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_upload_use_internal_tenant = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_volume_cache_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Starting volume driver QuobyteDriver (1.2) Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_volume_cache_max_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] image_volume_cache_max_size_gb = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] init_host_max_objects_retrieval = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] instance_format = [instance: %(uuid)s] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] iscsi_target_flags = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87111) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] iscsi_write_cache = on {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] iser_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] iser_ip_address = 192.168.122.164 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] iser_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_color = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_config_append = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_options = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_rotate_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_rotate_interval_type = days {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] log_rotation_type = none {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] max_age = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] max_logfile_count = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] max_logfile_size_mb = 200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] max_over_subscription_ratio = 20.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] message_reap_interval = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] message_ttl = 2592000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] migration_create_volume_timeout_secs = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] monkey_patch = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] monkey_patch_modules = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] my_ip = 192.168.122.164 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] no_snapshot_gb_quota = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] num_iser_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] num_shell_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] num_volume_device_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] nvmeof_conn_info_version = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] nvmet_ns_id = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] nvmet_port_id = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] osapi_max_limit = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] osapi_volume_ext_list = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] osapi_volume_listen_port = 8776 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] osapi_volume_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] osapi_volume_workers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] per_volume_size_limit = -1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] periodic_fuzzy_delay = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] periodic_interval = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] public_endpoint = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] publish_errors = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] quota_backup_gigabytes = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] quota_backups = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] quota_gigabytes = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] quota_groups = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] quota_snapshots = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] quota_volumes = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] rate_limit_burst = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] rate_limit_except_level = CRITICAL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] rate_limit_interval = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] reinit_driver_count = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] report_discard_supported = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] report_interval = 120 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] reservation_clean_interval = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] reservation_expire = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] reserved_image_namespaces = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] reserved_percentage = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:39 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] rpc_response_timeout = 120 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] run_external_periodic_tasks = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] scst_target_driver = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_down_time = 720 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] shell_completion = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] snapshot_name_template = snapshot-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] state_path = /opt/stack/data/cinder {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] storage_availability_zone = nova {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] storage_protocol = iSCSI {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] syslog_log_facility = LOG_USER {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] target_helper = lioadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] target_ip_address = 192.168.122.164 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] target_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] target_protocol = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] target_secondary_ip_addresses = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] transport_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] until_refresh = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] use_chap_auth = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] use_default_quota_class = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] use_journal = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] use_json = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] use_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] use_stderr = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] use_syslog = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] verify_glance_signatures = enabled {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_api_class = cinder.volume.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_clear = zero {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_clear_size = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_copy_bps_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_dd_blocksize = 1M {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_name_template = volume-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_service_inithost_offload = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volume_usage_audit_period = month {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] zoning_mode = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_concurrency.disable_process_locking = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.auth_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.include_service_catalog = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.interface = public {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87111) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Nov 05 03:40:40 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Running cmd (subprocess): mount.quobyte {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcache_username = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.service_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.164/identity {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.backend = dogpile.cache.null {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.backend_argument = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.backend_expiration_time = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.config_prefix = cache.oslo {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.debug_cache_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.enable_retry_client = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.enable_socket_keepalive = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.expiration_time = 600 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.hashclient_retry_attempts = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.memcache_dead_retry = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.memcache_pool_maxsize = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.memcache_sasl_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.proxies = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.redis_db = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.redis_server = localhost:6379 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.retry_attempts = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.retry_delay = 0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.socket_keepalive_count = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.socket_keepalive_idle = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.socket_keepalive_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.socket_timeout = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.tls_allowed_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.tls_cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.tls_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.tls_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.tls_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cache.username = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] coordination.backend_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.asyncio_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.asyncio_slave_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.backend = sqlalchemy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.connection_debug = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.connection_parameters = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.connection_recycle_time = 3600 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.connection_trace = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.db_inc_retry_interval = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.db_max_retries = 20 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.db_max_retry_interval = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.db_retry_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.max_overflow = 50 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.max_pool_size = 5 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.max_retries = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.mysql_wsrep_sync_wait = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.pool_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.retry_interval = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.slave_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.sqlite_synchronous = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.synchronous_reader = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] database.use_db_reconnect = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_tracing.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.connection_string = messaging:// {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.es_doc_type = notification {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.es_scroll_size = 10000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.es_scroll_time = 2m {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.filter_error_trace = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.hmac_keys = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.sentinel_service_name = mymaster {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.socket_timeout = 0.1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.trace_requests = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler.trace_sqlalchemy = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler_jaeger.process_tags = {} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler_jaeger.service_name_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] profiler_otlp.service_name_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.enforce_new_defaults = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.policy_default_rule = default {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.policy_file = policy.yaml {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack quobyte-client[87112]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] privsep_osbrick.group = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] privsep_osbrick.helper_command = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack quobyte-client[87112]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] privsep_osbrick.user = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_sys_admin.group = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_sys_admin.helper_command = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] cinder_sys_admin.user = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.send_service_user_token = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.tls_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] service_user.tls_min_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.tls_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] glance.tls_min_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.chap_username = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.driver_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.extra_capabilities = {} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.iscsi_target_flags = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.iscsi_write_cache = on {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.iser_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.iser_ip_address = 192.168.122.164 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.iser_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_host = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_login = admin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_mount_options = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_private_key = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_share_path = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.num_shell_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.quobyte_volume_url = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.report_discard_supported = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.reserved_percentage = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.target_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.target_ip_address = 192.168.122.164 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.target_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.target_protocol = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.unique_fqdn_network = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.use_chap_auth = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volume_backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volume_clear = zero {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volume_clear_size = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_reports.file_event_handler = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_reports.log_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.backend_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.chap_username = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.chiscsi_conf = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.driver_use_ssl = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.extra_capabilities = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.iser_helper = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.iser_ip_address = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.iser_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.iser_target_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_login = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_mount_options = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_private_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_share_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_ssh_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.num_shell_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.nvmet_port_id = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.report_discard_supported = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.reserved_percentage = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.scst_target_driver = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.storage_protocol = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.target_helper = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.target_ip_address = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.target_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.target_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.target_protocol = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.use_chap_auth = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volume_clear = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volume_clear_size = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] QuobyteHD.volumes_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_notifications.driver = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_notifications.retry = -1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] key_manager.fixed_key = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.barbican_api_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.barbican_endpoint = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.barbican_endpoint_type = public {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.barbican_region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.number_of_retries = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.retry_delay = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.send_service_user_token = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.tls_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.tls_min_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.verify_ssl = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican.verify_ssl_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.auth_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.tls_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] barbican_service_user.tls_min_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.approle_role_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.approle_secret_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.auth_method = approle {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.auth_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.kv_mountpoint = secret {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.kv_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.kv_version = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.root_token_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.ssl_ca_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.token_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.token_role = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:40 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-2b821d10-15d6-4c62-850f-c0030c905607 None None] ******************************************************************************** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 03:40:40 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.275s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:40 devstack cinder-volume[87111]: INFO cinder.volume.driver [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.volume.driver [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87111) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87111) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writer thread running {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.db.api [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Building query based on filter {{(pid=87111) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87111) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:40 devstack cinder-volume[87111]: INFO cinder.keymgr.migration [None req-6ee46cc3-5982-4dad-9b5f-4ccd46e2d5c8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 03:40:40 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:40:40 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:40 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.254s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:40:40 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Driver initialization completed successfully. Nov 05 03:40:40 devstack cinder-volume[87111]: INFO cinder.manager [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Initiating service 3 cleanup Nov 05 03:40:40 devstack cinder-volume[87111]: INFO cinder.manager [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Service 3 cleanup completed. Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.service [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Creating RPC server for service cinder-volume {{(pid=87111) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.service [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87111) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 03:40:40 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:40 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:40:40 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:41 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:41 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8ca6dbd2-20ce-4333-b1b4-f10958c65e21 None None] Driver post RPC initialization completed successfully. Nov 05 03:40:49 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:40:50 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:40:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:41:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:41:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 6 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:41:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Flow 'volume_create_manager' (f0620dbf-4581-4ef1-83bb-05318a3431b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d43be6-9714-4904-ab96-ebe4cc42edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d43be6-9714-4904-ab96-ebe4cc42edc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2039090290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20368817add4135af773955cf67f3bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:40Z,use_quota=True,user_id='891a7bf2ec374513827916375c607519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962a1b7d-7a13-4729-81bd-f14382a1b30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962a1b7d-7a13-4729-81bd-f14382a1b30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d87850-bafd-4e8e-a035-0272743e99af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d87850-bafd-4e8e-a035-0272743e99af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2', 'volume_name': 'volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fcc5a6-3994-4a7a-ba82-609ccef95198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fcc5a6-3994-4a7a-ba82-609ccef95198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e4e799-f0ad-4490-b481-fd4b3147dab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:40 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Volume fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2', 'volume_size': 1} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2039090290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20368817add4135af773955cf67f3bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:40Z,use_quota=True,user_id='891a7bf2ec374513827916375c607519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Creating volume fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:41:40 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:41:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:41:40 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 1073741824 Nov 05 03:41:40 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:41:41 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 1073741824" returned: 0 in 0.687s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:41:41 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 Nov 05 03:41:41 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:41:41 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2" returned: 0 in 0.263s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e4e799-f0ad-4490-b481-fd4b3147dab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edd9876-9b03-4d1a-a5ce-20240211d116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:41 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Volume volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 (fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2): created successfully Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edd9876-9b03-4d1a-a5ce-20240211d116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Flow 'volume_create_manager' (f0620dbf-4581-4ef1-83bb-05318a3431b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:41:41 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-37057ae6-33cf-41f7-9a21-19af13af20a7 tempest-TaggedAttachmentsTest-349688941 None] Created volume successfully. Nov 05 03:41:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:41:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:42:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:42:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:15 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:42:15 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:16 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.799s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:16 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:42:16 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:42:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 6 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:42:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Flow 'volume_create_manager' (3b0fbdf8-28cf-480f-b0fa-eb553a9fb33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e29a40-09fd-45f8-a9e1-5e43bb037429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e29a40-09fd-45f8-a9e1-5e43bb037429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1715041249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efdae93-f4c8-44be-8cde-e267bfe4d3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62869e395a7144ae8eb86124c0b45a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:19Z,use_quota=True,user_id='5ec2cd2478d84d1295b7092052ccd006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b9d057-9bd5-42a4-ada3-83db59ccab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b9d057-9bd5-42a4-ada3-83db59ccab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f40a0bd-47eb-49e4-a705-d67fb47f12be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f40a0bd-47eb-49e4-a705-d67fb47f12be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efdae93-f4c8-44be-8cde-e267bfe4d3e5', 'volume_name': 'volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b9bfc5-b69c-45e0-bb8e-69329fa8d8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b9bfc5-b69c-45e0-bb8e-69329fa8d8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1eb92ca-66a4-400a-9cec-07203707fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:19 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Volume 4efdae93-f4c8-44be-8cde-e267bfe4d3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5', 'volume_size': 1} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1715041249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efdae93-f4c8-44be-8cde-e267bfe4d3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62869e395a7144ae8eb86124c0b45a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:19Z,use_quota=True,user_id='5ec2cd2478d84d1295b7092052ccd006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Creating volume 4efdae93-f4c8-44be-8cde-e267bfe4d3e5 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:42:19 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:42:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:19 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 1073741824 Nov 05 03:42:19 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:20 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 1073741824" returned: 0 in 0.980s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:20 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 Nov 05 03:42:20 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:21 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5" returned: 0 in 0.768s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:42:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1eb92ca-66a4-400a-9cec-07203707fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853b2cef-0053-4daa-b5d1-2820ba846ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:21 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Volume volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 (4efdae93-f4c8-44be-8cde-e267bfe4d3e5): created successfully Nov 05 03:42:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853b2cef-0053-4daa-b5d1-2820ba846ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Flow 'volume_create_manager' (3b0fbdf8-28cf-480f-b0fa-eb553a9fb33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:21 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a13228d9-9bdf-4f47-85fa-d44b18550707 tempest-VolumesAdminNegativeTest-1099208532 None] Created volume successfully. Nov 05 03:42:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Acquiring lock "cinder-4efdae93-f4c8-44be-8cde-e267bfe4d3e5-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "cinder-4efdae93-f4c8-44be-8cde-e267bfe4d3e5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Acquiring lock "cinder-quobyte-4efdae93-f4c8-44be-8cde-e267bfe4d3e5" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "cinder-quobyte-4efdae93-f4c8-44be-8cde-e267bfe4d3e5" acquired by "delete_volume" :: waited 0.063s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:23 devstack cinder-volume[87111]: INFO oslo.privsep.daemon [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqfwc4nxb/privsep.sock'] Nov 05 03:42:23 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqfwc4nxb/privsep.sock Nov 05 03:42:23 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 03:42:25 devstack cinder-volume[87111]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 03:42:26 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:26 devstack cinder-volume[87111]: INFO oslo.privsep.daemon [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Spawned new privsep daemon via rootwrap Nov 05 03:42:26 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Accepted privsep connection to /tmp/tmpqfwc4nxb/privsep.sock {{(pid=87111) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 03:42:26 devstack cinder-volume[87111]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 03:42:26 devstack cinder-volume[87111]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 03:42:26 devstack cinder-volume[87111]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 03:42:26 devstack cinder-volume[87111]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88421 Nov 05 03:42:26 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea3ac4-b955-4444-9a42-8e3f5c20b4c6]: (2,) {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:26 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581734c-248d-4954-93ff-b9ab715a1992]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:26 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 Nov 05 03:42:26 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:27 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5" returned: 0 in 0.914s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:27 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5 Nov 05 03:42:27 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:27 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4efdae93-f4c8-44be-8cde-e267bfe4d3e5" returned: 0 in 0.449s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "cinder-quobyte-4efdae93-f4c8-44be-8cde-e267bfe4d3e5" released by "delete_volume" :: held 4.046s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:27 devstack cinder-volume[87111]: WARNING cinder.quota [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:42:27 devstack cinder-volume[87111]: WARNING cinder.quota [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:42:27 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Created reservations ['8c003f7a-33b3-4fc5-80ff-4bad8740e24e', '63e239e0-cd35-4c19-937b-a985817b61c6', '63d7bb17-d49a-46d4-a60c-fad4d8d96243', '08d8b628-c780-4414-9f8e-650f22a2b18b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:42:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:28 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:42:28 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:29 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.902s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:42:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Deleted volume successfully. Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-15ddba89-7272-48a1-8b32-2bebe398a274 tempest-VolumesAdminNegativeTest-1099208532 None] Lock "cinder-4efdae93-f4c8-44be-8cde-e267bfe4d3e5-delete_volume" released by "delete_volume" :: held 6.060s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Flow 'volume_create_manager' (1841dbf0-4060-4c87-a260-ec2ba1909e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8f3242-4fe2-494e-9ff3-b41f6fdfc8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8f3242-4fe2-494e-9ff3-b41f6fdfc8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1515745782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4619b6-eb98-468f-97e6-987f832bc26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad12ddb31cc468db60020f925f3bd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:30Z,use_quota=True,user_id='02863580dabb4688a0405c384d08a7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d04cb6-6212-439f-8be7-536c238aa6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d04cb6-6212-439f-8be7-536c238aa6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b75044a-f2d2-446b-9dba-695e1536f6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b75044a-f2d2-446b-9dba-695e1536f6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4619b6-eb98-468f-97e6-987f832bc26b', 'volume_name': 'volume-ea4619b6-eb98-468f-97e6-987f832bc26b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4824786a-e67a-4d9d-a80f-8fd568cd0e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4824786a-e67a-4d9d-a80f-8fd568cd0e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a759c37e-f097-4513-821e-29e384e7a0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Volume ea4619b6-eb98-468f-97e6-987f832bc26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4619b6-eb98-468f-97e6-987f832bc26b', 'volume_size': 1} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1515745782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4619b6-eb98-468f-97e6-987f832bc26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad12ddb31cc468db60020f925f3bd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:30Z,use_quota=True,user_id='02863580dabb4688a0405c384d08a7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Creating volume ea4619b6-eb98-468f-97e6-987f832bc26b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:42:29 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:42:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:30 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b 1073741824 Nov 05 03:42:30 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:31 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b 1073741824" returned: 0 in 1.271s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:31 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b Nov 05 03:42:31 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:32 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b" returned: 0 in 0.783s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:42:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a759c37e-f097-4513-821e-29e384e7a0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4619b6-eb98-468f-97e6-987f832bc26b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4569a8-3841-442f-aa2b-71b6f9fa4994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:32 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Volume volume-ea4619b6-eb98-468f-97e6-987f832bc26b (ea4619b6-eb98-468f-97e6-987f832bc26b): created successfully Nov 05 03:42:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4569a8-3841-442f-aa2b-71b6f9fa4994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Flow 'volume_create_manager' (1841dbf0-4060-4c87-a260-ec2ba1909e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-da26de10-b8a1-4c0f-b647-d86e019fc05b tempest-ServerRescueNegativeTestJSON-492992189 None] Created volume successfully. Nov 05 03:42:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:42:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=19,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:42:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Acquiring lock "cinder-ea4619b6-eb98-468f-97e6-987f832bc26b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "cinder-ea4619b6-eb98-468f-97e6-987f832bc26b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Acquiring lock "cinder-quobyte-ea4619b6-eb98-468f-97e6-987f832bc26b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "cinder-quobyte-ea4619b6-eb98-468f-97e6-987f832bc26b" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:55 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd26b2b-3696-4bb3-bd86-49835e12ca83]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:55 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b Nov 05 03:42:55 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:56 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b" returned: 0 in 0.446s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:56 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b Nov 05 03:42:56 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:56 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea4619b6-eb98-468f-97e6-987f832bc26b" returned: 0 in 0.389s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "cinder-quobyte-ea4619b6-eb98-468f-97e6-987f832bc26b" released by "delete_volume" :: held 0.906s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:56 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Created reservations ['40abd2fb-479f-4bde-94e7-d5484d1d301a', '9710050a-cece-41a7-8a44-3bbb976ca506', '75f9c1b9-2d69-4e33-8c73-7e85b63d8a58', '8da88542-de1d-42c1-ac6b-354378ddf65d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:57 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:42:57 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:57 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.273s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:42:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Deleted volume successfully. Nov 05 03:42:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ad22d3e8-a88e-4b89-aa0b-7a4c59cefb54 tempest-ServerRescueNegativeTestJSON-492992189 None] Lock "cinder-ea4619b6-eb98-468f-97e6-987f832bc26b-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:07 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=3 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:43:07 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:15 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:43:15 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:15 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.368s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:43:18 devstack cinder-volume[87111]: WARNING py.warnings [req-c7ed1a47-009c-4825-9864-c969ef5599a4 req-a9c49480-c557-4bd2-9239-ba34fed50de7 tempest-TaggedAttachmentsTest-349688941 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 05 03:43:18 devstack cinder-volume[87111]: .first() Nov 05 03:43:18 devstack cinder-volume[87111]: Nov 05 03:43:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-c7ed1a47-009c-4825-9864-c969ef5599a4 req-a9c49480-c557-4bd2-9239-ba34fed50de7 tempest-TaggedAttachmentsTest-349688941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-c7ed1a47-009c-4825-9864-c969ef5599a4 req-a9c49480-c557-4bd2-9239-ba34fed50de7 tempest-TaggedAttachmentsTest-349688941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-c7ed1a47-009c-4825-9864-c969ef5599a4 req-a9c49480-c557-4bd2-9239-ba34fed50de7 tempest-TaggedAttachmentsTest-349688941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-c7ed1a47-009c-4825-9864-c969ef5599a4 req-a9c49480-c557-4bd2-9239-ba34fed50de7 tempest-TaggedAttachmentsTest-349688941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df93684c-d31a-447c-b0e9-9ec7d79413b5', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:43:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-c7ed1a47-009c-4825-9864-c969ef5599a4 req-a9c49480-c557-4bd2-9239-ba34fed50de7 tempest-TaggedAttachmentsTest-349688941 None] attachment_update completed successfully. Nov 05 03:43:23 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-7b370872-d4de-48ac-85d1-2a2a9220d496 req-b382b161-ca14-4ebe-8186-3cc503fc6200 tempest-TaggedAttachmentsTest-349688941 None] Terminate volume connection completed successfully. Nov 05 03:43:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-7b370872-d4de-48ac-85d1-2a2a9220d496 req-b382b161-ca14-4ebe-8186-3cc503fc6200 tempest-TaggedAttachmentsTest-349688941 None] Deleting attachment df93684c-d31a-447c-b0e9-9ec7d79413b5. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:43:28 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Flow 'volume_create_manager' (8d163b08-06e2-415f-a3ec-414ddc534cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28518a4c-3a62-4385-8329-03284c07992f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28518a4c-3a62-4385-8329-03284c07992f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2093634774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ada333-1403-447d-80c0-261c60fb405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc3e1dac61e468c834303f15105f800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:31Z,use_quota=True,user_id='9c74e30860d94e39b1ca329a3b1d251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683c31f3-ddc9-4e99-838c-ce096454f551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683c31f3-ddc9-4e99-838c-ce096454f551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a13ce79-8f88-4e80-adaa-a19462a094dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a13ce79-8f88-4e80-adaa-a19462a094dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ada333-1403-447d-80c0-261c60fb405c', 'volume_name': 'volume-b5ada333-1403-447d-80c0-261c60fb405c', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90218639-fde2-4267-9e26-788b21944035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90218639-fde2-4267-9e26-788b21944035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9959150e-e3e1-48aa-ae30-4b813447f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:31 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Volume b5ada333-1403-447d-80c0-261c60fb405c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ada333-1403-447d-80c0-261c60fb405c', 'volume_size': 1} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2093634774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ada333-1403-447d-80c0-261c60fb405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc3e1dac61e468c834303f15105f800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:31Z,use_quota=True,user_id='9c74e30860d94e39b1ca329a3b1d251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Creating volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:43:31 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:43:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:31 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c 1073741824 Nov 05 03:43:31 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:32 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c 1073741824" returned: 0 in 0.678s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:32 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c Nov 05 03:43:32 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:32 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c" returned: 0 in 0.328s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9959150e-e3e1-48aa-ae30-4b813447f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ada333-1403-447d-80c0-261c60fb405c', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6057aa97-b45f-4077-8123-2a70a3c07f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:32 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Volume volume-b5ada333-1403-447d-80c0-261c60fb405c (b5ada333-1403-447d-80c0-261c60fb405c): created successfully Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6057aa97-b45f-4077-8123-2a70a3c07f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Flow 'volume_create_manager' (8d163b08-06e2-415f-a3ec-414ddc534cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c9aa1c86-617a-44c4-8070-8d5c1a2ae03e tempest-SnapshotsActionsTest-25488993 None] Created volume successfully. Nov 05 03:43:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Creating offline snapshot 33ec91ca-3429-460f-be5c-f931de46bfe9 of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:43:34 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc6fa25-6590-43bc-bcf9-0b76ecf4e0e2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:34 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c Nov 05 03:43:34 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:34 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c" returned: 0 in 0.439s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:34 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 1G Nov 05 03:43:34 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:35 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 1G" returned: 0 in 0.636s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:35 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:35 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:35 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.455s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:35 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 is being set with open permissions: ugo+rw Nov 05 03:43:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:35 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:35 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:36 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.528s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:36 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.info Nov 05 03:43:36 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:36 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.info" returned: 0 in 0.545s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:36 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.info is being set with open permissions: ugo+rw Nov 05 03:43:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:36 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.info Nov 05 03:43:36 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:37 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.info" returned: 0 in 0.477s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.237s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5e456b62-c13a-447b-b07d-61c89f99ab27 tempest-SnapshotsActionsTest-25488993 None] Create snapshot completed successfully Nov 05 03:43:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Acquiring lock "cinder-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Lock "cinder-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Acquiring lock "cinder-quobyte-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Lock "cinder-quobyte-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:37 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1757b7f4-ba60-4cac-a580-e9f5213a6b7f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:38 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 Nov 05 03:43:38 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:38 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2" returned: 0 in 0.442s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:38 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2 Nov 05 03:43:38 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:38 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2" returned: 0 in 0.418s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Lock "cinder-quobyte-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2" released by "delete_volume" :: held 0.938s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:38 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Created reservations ['9f9b0fe3-3f24-4808-b61b-42bb03c09138', 'e7944e17-31eb-4d5e-b073-040ab7169859', '244b6263-33e7-4e86-b6a1-2c5de7e0c3c9', '6442cb1f-1f86-405c-bd6a-17d14c6b3ede'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:39 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:43:39 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Creating offline snapshot c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Flow 'volume_create_manager' (dadff1ca-0b02-421e-8bb6-609fab9567be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e756f13-5bdb-4132-9a0c-830235d1583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49337e1-ebfd-4ee0-8e8c-4ffe81768cf4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e756f13-5bdb-4132-9a0c-830235d1583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1954794798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659003c6-befc-45c2-b6b7-146e0907ca6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52678b45d888416e97e9d71d34474f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:39Z,use_quota=True,user_id='c9420199e3e048b38ab557ff44c53c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cc539e-1d15-4dd4-89c9-1d0443cc31f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cc539e-1d15-4dd4-89c9-1d0443cc31f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3daf783a-aa8c-4adc-9936-15538884f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3daf783a-aa8c-4adc-9936-15538884f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659003c6-befc-45c2-b6b7-146e0907ca6b', 'volume_name': 'volume-659003c6-befc-45c2-b6b7-146e0907ca6b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aea034c-510b-409a-a536-8fe058d7bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aea034c-510b-409a-a536-8fe058d7bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d7ce65-ac59-497f-82b7-74f98cbe001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:39 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Volume 659003c6-befc-45c2-b6b7-146e0907ca6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659003c6-befc-45c2-b6b7-146e0907ca6b', 'volume_size': 1} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:39 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:39 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:39 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.426s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:43:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Deleted volume successfully. Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-545d6c91-19a4-47cc-bfc5-2fa9e705b4b9 tempest-TaggedAttachmentsTest-349688941 None] Lock "cinder-fa42b904-1dcf-4ffc-9cf5-1d69de3ea0d2-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:39 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.478s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:39 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 1G Nov 05 03:43:39 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:40 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 1G" returned: 0 in 0.809s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:40 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 Nov 05 03:43:40 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:41 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9" returned: 0 in 0.537s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:41 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 is being set with open permissions: ugo+rw Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:41 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 Nov 05 03:43:41 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:41 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9" returned: 0 in 0.317s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.101s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1954794798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659003c6-befc-45c2-b6b7-146e0907ca6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52678b45d888416e97e9d71d34474f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:39Z,use_quota=True,user_id='c9420199e3e048b38ab557ff44c53c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Creating volume 659003c6-befc-45c2-b6b7-146e0907ca6b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:43:41 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:41 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b 1073741824 Nov 05 03:43:41 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:41 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ea0bdee1-ce55-47f1-a91a-1aec79dec15d tempest-SnapshotsActionsTest-25488993 None] Create snapshot completed successfully Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Flow 'volume_create_manager' (020a876f-a2c1-4455-9231-6f5166430d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96248060-611d-47b1-b703-6d580f2dc67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96248060-611d-47b1-b703-6d580f2dc67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1206398911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abd3fa4-cb2f-48b5-af12-5eb4d78bd058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e96fe953b54aae88d89bce85a32a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:42Z,use_quota=True,user_id='e02a7e965c2c4e8f886b553bc7bb2f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79b7747-79c2-4635-9a3c-a182097f511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79b7747-79c2-4635-9a3c-a182097f511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b6262a-6d4c-47cd-abbe-2f87fd534dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b6262a-6d4c-47cd-abbe-2f87fd534dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0abd3fa4-cb2f-48b5-af12-5eb4d78bd058', 'volume_name': 'volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d93546f-0087-4c14-9dab-4ef32c136a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d93546f-0087-4c14-9dab-4ef32c136a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213817fc-13de-474a-9c50-ebe1147a4a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:41 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Volume 0abd3fa4-cb2f-48b5-af12-5eb4d78bd058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058', 'volume_size': 1} Nov 05 03:43:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:42 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b 1073741824" returned: 0 in 0.641s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:42 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b Nov 05 03:43:42 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-quobyte-c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Deleting offline snapshot c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] snapshot_file for this snap is: volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e0ea2-be12-4596-98f5-84acc7278849]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:42 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b" returned: 0 in 0.403s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.924s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1206398911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abd3fa4-cb2f-48b5-af12-5eb4d78bd058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e96fe953b54aae88d89bce85a32a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:42Z,use_quota=True,user_id='e02a7e965c2c4e8f886b553bc7bb2f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Creating volume 0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:43:42 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:42 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 Nov 05 03:43:42 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d7ce65-ac59-497f-82b7-74f98cbe001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659003c6-befc-45c2-b6b7-146e0907ca6b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:42 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 1073741824 Nov 05 03:43:42 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5a9183-0bd9-439f-9b33-a12529f0e759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:42 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Volume volume-659003c6-befc-45c2-b6b7-146e0907ca6b (659003c6-befc-45c2-b6b7-146e0907ca6b): created successfully Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5a9183-0bd9-439f-9b33-a12529f0e759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Flow 'volume_create_manager' (dadff1ca-0b02-421e-8bb6-609fab9567be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:42 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7ffa8918-b2e4-48e2-b112-dd105c36ee0a tempest-DeleteServersTestJSON-2053422111 None] Created volume successfully. Nov 05 03:43:43 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9" returned: 0 in 0.457s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5c0132-049c-46c4-aaed-363ce2fd1ed6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:43 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:43 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:43 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 1073741824" returned: 0 in 0.554s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:43 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 Nov 05 03:43:43 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:43 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.646s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:43 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058" returned: 0 in 0.453s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:43 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 Nov 05 03:43:43 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213817fc-13de-474a-9c50-ebe1147a4a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a55ee92-5836-4aad-8d10-90955ce21c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:43 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Volume volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 (0abd3fa4-cb2f-48b5-af12-5eb4d78bd058): created successfully Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a55ee92-5836-4aad-8d10-90955ce21c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Flow 'volume_create_manager' (020a876f-a2c1-4455-9231-6f5166430d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:43 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8ec3bab6-bd17-4011-b417-a010f4d90d02 tempest-AttachVolumeShelveTestJSON-157205052 None] Created volume successfully. Nov 05 03:43:44 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9" returned: 0 in 0.582s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:44 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9 Nov 05 03:43:44 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:44 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-598e0f59-3418-47f1-a032-04c35f84399c req-c215ce19-4d32-4f8d-b8ad-6a708839fb76 tempest-DeleteServersTestJSON-2053422111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-598e0f59-3418-47f1-a032-04c35f84399c req-c215ce19-4d32-4f8d-b8ad-6a708839fb76 tempest-DeleteServersTestJSON-2053422111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9" released by "_delete_snapshot" :: held 2.131s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" released by "delete_snapshot" :: held 2.173s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-598e0f59-3418-47f1-a032-04c35f84399c req-c215ce19-4d32-4f8d-b8ad-6a708839fb76 tempest-DeleteServersTestJSON-2053422111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-598e0f59-3418-47f1-a032-04c35f84399c req-c215ce19-4d32-4f8d-b8ad-6a708839fb76 tempest-DeleteServersTestJSON-2053422111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-659003c6-befc-45c2-b6b7-146e0907ca6b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '425cf111-ae20-4edc-947f-e15dcaefb404', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:43:44 devstack cinder-volume[87111]: WARNING cinder.quota [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:43:44 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Created reservations ['2f6a02a0-1300-4275-973f-7a064413c00d', '7939d67c-858e-43b9-bd5b-81dfb2056ad3', 'f90c0b39-e9f9-42a8-b4a3-897ad0f0f564', '86dd6f0a-8104-41af-98b8-3c220d9cf71e'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:44 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-598e0f59-3418-47f1-a032-04c35f84399c req-c215ce19-4d32-4f8d-b8ad-6a708839fb76 tempest-DeleteServersTestJSON-2053422111 None] attachment_update completed successfully. Nov 05 03:43:44 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Delete snapshot completed successfully. Nov 05 03:43:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-53b9819f-9ffa-478b-a2e6-fb7f5c6b1a32 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-c8f22eea-b8bf-4fbd-894b-1dd49f82f2f9-delete_snapshot" released by "delete_snapshot" :: held 2.474s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Creating offline snapshot da8d2866-d4d8-424b-8b18-4e825bbcfb8e of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:43:46 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30e3936-7939-419b-8bdb-41e6bb221e65]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:46 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:46 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:47 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.588s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:47 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e 1G Nov 05 03:43:47 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:48 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e 1G" returned: 0 in 0.946s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:48 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e Nov 05 03:43:48 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:48 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e" returned: 0 in 0.496s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:48 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e is being set with open permissions: ugo+rw Nov 05 03:43:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:48 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e Nov 05 03:43:48 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:48 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e" returned: 0 in 0.342s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d3b46188-ef31-4a28-b420-05cf85b74004 tempest-SnapshotsActionsTest-25488993 None] Create snapshot completed successfully Nov 05 03:43:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-45e6b5ed-0cf4-4020-8835-c273adb76d82 req-8a4c1bf2-923e-4a52-94b9-5b1d81dcae7a tempest-DeleteServersTestJSON-2053422111 None] Terminate volume connection completed successfully. Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-45e6b5ed-0cf4-4020-8835-c273adb76d82 req-8a4c1bf2-923e-4a52-94b9-5b1d81dcae7a tempest-DeleteServersTestJSON-2053422111 None] Deleting attachment 425cf111-ae20-4edc-947f-e15dcaefb404. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-da8d2866-d4d8-424b-8b18-4e825bbcfb8e-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-da8d2866-d4d8-424b-8b18-4e825bbcfb8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-quobyte-da8d2866-d4d8-424b-8b18-4e825bbcfb8e" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-da8d2866-d4d8-424b-8b18-4e825bbcfb8e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Deleting offline snapshot da8d2866-d4d8-424b-8b18-4e825bbcfb8e of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] snapshot_file for this snap is: volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca96a34-427d-4ff9-a967-23183d90953c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:50 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e Nov 05 03:43:50 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:50 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e" returned: 0 in 0.481s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:50 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f8fc37-5cc2-491e-8d40-44e0bbfd86ab]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:50 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:50 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:51 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.553s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:51 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e Nov 05 03:43:51 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Acquiring lock "cinder-659003c6-befc-45c2-b6b7-146e0907ca6b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Lock "cinder-659003c6-befc-45c2-b6b7-146e0907ca6b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Acquiring lock "cinder-quobyte-659003c6-befc-45c2-b6b7-146e0907ca6b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Lock "cinder-quobyte-659003c6-befc-45c2-b6b7-146e0907ca6b" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d53a52-4708-47d8-b248-9b328031c4fd]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:51 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e" returned: 0 in 0.612s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:51 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b Nov 05 03:43:51 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:51 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e Nov 05 03:43:51 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:51 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.da8d2866-d4d8-424b-8b18-4e825bbcfb8e" returned: 0 in 0.288s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-da8d2866-d4d8-424b-8b18-4e825bbcfb8e" released by "_delete_snapshot" :: held 2.155s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" released by "delete_snapshot" :: held 2.209s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:52 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b" returned: 0 in 0.504s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:52 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b Nov 05 03:43:52 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Created reservations ['97257cff-dad4-4f23-96d2-de2232122742', 'b7c2bf77-3d6d-4dba-8206-9ec9f46fd1a5', 'e1f33814-2a40-43a4-8e58-023e64b746d6', 'd3301c19-f39e-4dbc-b132-b736e9e102f8'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Delete snapshot completed successfully. Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d395ced-722a-43e3-bf86-82d053510509 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-da8d2866-d4d8-424b-8b18-4e825bbcfb8e-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:52 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-659003c6-befc-45c2-b6b7-146e0907ca6b" returned: 0 in 0.349s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Lock "cinder-quobyte-659003c6-befc-45c2-b6b7-146e0907ca6b" released by "delete_volume" :: held 0.930s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Created reservations ['130583e8-06ea-45fb-893c-4d98c2d0d9b3', '8ba3ec8d-eb65-48cb-9937-9dde324c3e49', 'fe2fd76c-19bb-4ff5-91fd-b8d58c65e5a3', '58001d84-9e34-49b3-a25b-88e6523fdb3a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:52 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:43:52 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:52 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.290s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:52 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:43:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Deleted volume successfully. Nov 05 03:43:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fbb18f11-ece6-48dc-bfc1-944a93c2ec29 tempest-DeleteServersTestJSON-2053422111 None] Lock "cinder-659003c6-befc-45c2-b6b7-146e0907ca6b-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Creating offline snapshot 5e29c0ff-6d48-45fb-b922-14d8081cd50f of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:43:53 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4205871c-0758-45bb-9635-e4ad7b6f03d2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:53 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:53 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:53 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.451s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:54 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f 1G Nov 05 03:43:54 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:54 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f 1G" returned: 0 in 0.533s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:54 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f Nov 05 03:43:54 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:55 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f" returned: 0 in 0.552s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:55 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f is being set with open permissions: ugo+rw Nov 05 03:43:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:55 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f Nov 05 03:43:55 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:55 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f" returned: 0 in 0.347s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cbca2233-1442-4a4b-9cd9-20567881a401 tempest-SnapshotsActionsTest-25488993 None] Create snapshot completed successfully Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-5e29c0ff-6d48-45fb-b922-14d8081cd50f-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-5e29c0ff-6d48-45fb-b922-14d8081cd50f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-quobyte-5e29c0ff-6d48-45fb-b922-14d8081cd50f" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-5e29c0ff-6d48-45fb-b922-14d8081cd50f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Deleting offline snapshot 5e29c0ff-6d48-45fb-b922-14d8081cd50f of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] snapshot_file for this snap is: volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fb9311-1437-4aaa-b87d-b6e36c8eb2b3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:57 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f Nov 05 03:43:57 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d098f66a-cf7b-4830-9127-3ba14f27aa9a req-a6e2c147-8344-4e64-b8d9-88a5d3f9b4af tempest-AttachVolumeShelveTestJSON-157205052 None] No connector for attachment d5aeca49-08f6-4ce1-980f-30fe48fe97d3; skipping storage backend terminate_connection call. {{(pid=87111) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5031}} Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d098f66a-cf7b-4830-9127-3ba14f27aa9a req-a6e2c147-8344-4e64-b8d9-88a5d3f9b4af tempest-AttachVolumeShelveTestJSON-157205052 None] Deleting attachment d5aeca49-08f6-4ce1-980f-30fe48fe97d3. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:43:57 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f" returned: 0 in 0.470s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dbf88e-d427-4487-8ede-b061f154f977]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:57 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:57 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:57 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.424s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:57 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f Nov 05 03:43:57 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:58 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f" returned: 0 in 0.433s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:58 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f Nov 05 03:43:58 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:58 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.5e29c0ff-6d48-45fb-b922-14d8081cd50f" returned: 0 in 0.312s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-5e29c0ff-6d48-45fb-b922-14d8081cd50f" released by "_delete_snapshot" :: held 1.817s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" released by "delete_snapshot" :: held 1.845s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:58 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Created reservations ['6260d533-1cf8-45ef-b144-245b957511a9', 'ebdc2de4-d875-48f1-8cf5-5c7b089dda67', '0956db89-cff0-4417-9e12-f3456c0da5fa', 'f8a3f39c-dc97-4e16-b0bd-dbcf83efba39'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Delete snapshot completed successfully. Nov 05 03:43:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21693a8b-cdbb-4d23-a3f1-f0f7f7f68ae6 tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-5e29c0ff-6d48-45fb-b922-14d8081cd50f-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Creating offline snapshot dafe76b3-7c78-421c-89f9-0a06848bf064 of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:43:59 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a4adf3-1e2c-4813-a1ee-f6260adff5f4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:59 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:43:59 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:00 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.466s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:44:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:00 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 1G Nov 05 03:44:00 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:00 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 1G" returned: 0 in 0.587s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:00 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 Nov 05 03:44:00 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:01 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064" returned: 0 in 0.545s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:01 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 is being set with open permissions: ugo+rw Nov 05 03:44:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:01 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 Nov 05 03:44:01 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:01 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064" returned: 0 in 0.390s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0d91d491-2713-4dc0-8fc0-6bbe4fbc1f77 tempest-SnapshotsActionsTest-25488993 None] Create snapshot completed successfully Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-dafe76b3-7c78-421c-89f9-0a06848bf064-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-dafe76b3-7c78-421c-89f9-0a06848bf064-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Acquiring lock "cinder-quobyte-dafe76b3-7c78-421c-89f9-0a06848bf064" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-dafe76b3-7c78-421c-89f9-0a06848bf064" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Deleting offline snapshot dafe76b3-7c78-421c-89f9-0a06848bf064 of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] snapshot_file for this snap is: volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4156c403-0677-46b0-b679-b7bc3d775723]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:03 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 Nov 05 03:44:03 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:03 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064" returned: 0 in 0.451s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:44:03 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac187f6-d7ab-4651-8728-a55273f3772e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:03 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:44:03 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:03 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.569s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:44:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:04 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 Nov 05 03:44:04 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:04 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064" returned: 0 in 0.492s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:04 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064 Nov 05 03:44:04 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:04 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.dafe76b3-7c78-421c-89f9-0a06848bf064" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-dafe76b3-7c78-421c-89f9-0a06848bf064" released by "_delete_snapshot" :: held 1.961s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" released by "delete_snapshot" :: held 1.990s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:04 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Created reservations ['c2b9fafa-fea0-49a0-ba1f-027745621629', '99779621-8022-438c-8369-9ff361181a7a', 'c311e7ef-2d4d-4e1b-832a-99d8caa3be83', 'fb01cb44-34bb-4069-979b-d75012441d02'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Delete snapshot completed successfully. Nov 05 03:44:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bc524533-c1d3-406e-a87a-be9c4d7fa16c tempest-SnapshotsActionsTest-1249498706 None] Lock "cinder-dafe76b3-7c78-421c-89f9-0a06848bf064-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "cinder-33ec91ca-3429-460f-be5c-f931de46bfe9-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-33ec91ca-3429-460f-be5c-f931de46bfe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "cinder-quobyte-33ec91ca-3429-460f-be5c-f931de46bfe9" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-quobyte-33ec91ca-3429-460f-be5c-f931de46bfe9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Deleting offline snapshot 33ec91ca-3429-460f-be5c-f931de46bfe9 of volume b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] snapshot_file for this snap is: volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[764c2803-3810-4c70-8470-5c4a5743718f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:07 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:44:07 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:07 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.505s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ada333-1403-447d-80c0-261c60fb405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:44:07 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[97865a86-2fcb-4a06-9354-ab567eaf63d8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:07 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c Nov 05 03:44:07 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:07 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c" returned: 0 in 0.469s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:07 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:44:07 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:08 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.411s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:08 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9 Nov 05 03:44:08 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:08 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c.33ec91ca-3429-460f-be5c-f931de46bfe9" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-quobyte-33ec91ca-3429-460f-be5c-f931de46bfe9" released by "_delete_snapshot" :: held 1.831s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" released by "delete_snapshot" :: held 1.866s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:08 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Created reservations ['dad9b4d5-3464-48a1-94ef-ee6fd8cb09ac', '38ddc0d0-9b4c-4129-940b-ee11be12febf', '3b4b3ace-2a56-436c-b4c8-09aedec186de', '61570c30-75a2-44e9-ace3-d7511f98a905'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:08 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Delete snapshot completed successfully. Nov 05 03:44:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-07994e31-3868-48c7-963a-cc8070620765 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-33ec91ca-3429-460f-be5c-f931de46bfe9-delete_snapshot" released by "delete_snapshot" :: held 2.066s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "cinder-b5ada333-1403-447d-80c0-261c60fb405c-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-b5ada333-1403-447d-80c0-261c60fb405c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d573c32-ba08-4cfc-a1d6-7730207cc3a4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:09 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c Nov 05 03:44:09 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:09 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c" returned: 0 in 0.434s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:09 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c Nov 05 03:44:09 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:09 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5ada333-1403-447d-80c0-261c60fb405c" returned: 0 in 0.276s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-quobyte-b5ada333-1403-447d-80c0-261c60fb405c" released by "delete_volume" :: held 0.797s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Created reservations ['7df922ca-5d35-4db3-bf59-d7336ffece28', '11ff2ece-4028-4768-a216-1dc11572fb02', 'c64fe8e2-48cd-468c-bdef-27f3ab89b8d0', '3fc36cef-fa17-481e-9de7-cfb00c923013'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:10 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:44:10 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:10 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.523s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Deleted volume successfully. Nov 05 03:44:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a079f11d-c411-4948-b3ec-ea2cb04f8052 tempest-SnapshotsActionsTest-25488993 None] Lock "cinder-b5ada333-1403-447d-80c0-261c60fb405c-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:15 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:44:15 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:15 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.343s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 8 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:44:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:44:20 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=73,cinder:UPDATE=66,cinder:DELETE=3,cinder:INSERT=21 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:44:20 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=74,cinder:UPDATE=69,cinder:INSERT=15,cinder:DELETE=8 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Flow 'volume_create_manager' (78788f74-5333-461a-bdeb-b775b038d8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b5f836-9466-4e04-a683-5b0282b0c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b5f836-9466-4e04-a683-5b0282b0c278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1360348317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06bf005-12af-4c97-9f2c-3dc195265489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8b4af27b0943c297a508d9f117b4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:22Z,use_quota=True,user_id='66dc5224a20c4c1c9df3daa240de3b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02176640-27f8-4d47-aae1-1a491c0eaee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02176640-27f8-4d47-aae1-1a491c0eaee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e82060b-d0b3-4b02-93f8-2cfe1b81fafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e82060b-d0b3-4b02-93f8-2cfe1b81fafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06bf005-12af-4c97-9f2c-3dc195265489', 'volume_name': 'volume-b06bf005-12af-4c97-9f2c-3dc195265489', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c676422b-34af-4034-b02a-c98a1daf6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c676422b-34af-4034-b02a-c98a1daf6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad15e6fa-3d2d-4152-82f0-9233c7bf39ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:22 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Volume b06bf005-12af-4c97-9f2c-3dc195265489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06bf005-12af-4c97-9f2c-3dc195265489', 'volume_size': 1} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1360348317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06bf005-12af-4c97-9f2c-3dc195265489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8b4af27b0943c297a508d9f117b4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:22Z,use_quota=True,user_id='66dc5224a20c4c1c9df3daa240de3b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Creating volume b06bf005-12af-4c97-9f2c-3dc195265489 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:44:22 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:44:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:22 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 1073741824 Nov 05 03:44:22 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 1073741824" returned: 0 in 1.011s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:23 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:23 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 Nov 05 03:44:23 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:24 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489" returned: 0 in 0.651s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:44:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad15e6fa-3d2d-4152-82f0-9233c7bf39ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06bf005-12af-4c97-9f2c-3dc195265489', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc20a5c7-5fc3-46b0-86b4-3f93413a8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Volume volume-b06bf005-12af-4c97-9f2c-3dc195265489 (b06bf005-12af-4c97-9f2c-3dc195265489): created successfully Nov 05 03:44:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc20a5c7-5fc3-46b0-86b4-3f93413a8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Flow 'volume_create_manager' (78788f74-5333-461a-bdeb-b775b038d8fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-db8d8d02-0905-47b5-9f5d-07950110cc7a tempest-VolumeQuotasAdminTestJSON-1451137192 None] Created volume successfully. Nov 05 03:44:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Acquiring lock "cinder-b06bf005-12af-4c97-9f2c-3dc195265489-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "cinder-b06bf005-12af-4c97-9f2c-3dc195265489-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Acquiring lock "cinder-quobyte-b06bf005-12af-4c97-9f2c-3dc195265489" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "cinder-quobyte-b06bf005-12af-4c97-9f2c-3dc195265489" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:25 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e56284e-feca-477c-a7de-7890f575c89b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:26 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 Nov 05 03:44:26 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:26 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489" returned: 0 in 0.724s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:26 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489 Nov 05 03:44:26 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:27 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b06bf005-12af-4c97-9f2c-3dc195265489" returned: 0 in 0.475s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "cinder-quobyte-b06bf005-12af-4c97-9f2c-3dc195265489" released by "delete_volume" :: held 1.326s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Created reservations ['88986c9a-014c-42ca-80bf-5543d5864304', '3139cdba-f63a-4f4a-95c9-555c312b0614', '82d0af90-454e-430b-a695-9c07a0ce36a0', 'c6ba35ca-7b2b-41f5-b076-a6fac4dff071'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:27 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:44:27 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:27 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.444s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Deleted volume successfully. Nov 05 03:44:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a7ece4e4-06ba-444a-a7cf-d9a3b74d7e40 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "cinder-b06bf005-12af-4c97-9f2c-3dc195265489-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Flow 'volume_create_manager' (e8eb0ea4-7f71-4978-a13e-5072068f7bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47bac9a-1484-4053-8f9e-dc85086e05bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47bac9a-1484-4053-8f9e-dc85086e05bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-274232708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e157e8c-9f64-4072-be9f-77e6383d727a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8b4af27b0943c297a508d9f117b4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:30Z,use_quota=True,user_id='66dc5224a20c4c1c9df3daa240de3b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b8a9e8-5f67-4882-8009-fc8199914460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b8a9e8-5f67-4882-8009-fc8199914460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe35a60a-7044-4f5c-be29-2e10874d0b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe35a60a-7044-4f5c-be29-2e10874d0b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e157e8c-9f64-4072-be9f-77e6383d727a', 'volume_name': 'volume-4e157e8c-9f64-4072-be9f-77e6383d727a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0bfa74-1ae5-47bf-b0fa-2752bb431de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0bfa74-1ae5-47bf-b0fa-2752bb431de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bf03bb-1c84-44ba-a68f-4f179c9769cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Volume 4e157e8c-9f64-4072-be9f-77e6383d727a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e157e8c-9f64-4072-be9f-77e6383d727a', 'volume_size': 1} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-274232708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e157e8c-9f64-4072-be9f-77e6383d727a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8b4af27b0943c297a508d9f117b4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:30Z,use_quota=True,user_id='66dc5224a20c4c1c9df3daa240de3b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Creating volume 4e157e8c-9f64-4072-be9f-77e6383d727a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:44:29 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:44:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:29 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a 1073741824 Nov 05 03:44:29 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:30 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a 1073741824" returned: 0 in 0.860s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:30 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a Nov 05 03:44:30 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:31 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a" returned: 0 in 0.678s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:44:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bf03bb-1c84-44ba-a68f-4f179c9769cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e157e8c-9f64-4072-be9f-77e6383d727a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3bd889-eb93-4cb2-a03c-9b4a99466483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:31 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Volume volume-4e157e8c-9f64-4072-be9f-77e6383d727a (4e157e8c-9f64-4072-be9f-77e6383d727a): created successfully Nov 05 03:44:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3bd889-eb93-4cb2-a03c-9b4a99466483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Flow 'volume_create_manager' (e8eb0ea4-7f71-4978-a13e-5072068f7bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-85edf225-b9a4-4b2f-82d1-b7c337cacb91 tempest-VolumeQuotasAdminTestJSON-1451137192 None] Created volume successfully. Nov 05 03:44:34 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0597d62b-03d2-46d6-bef5-8bb7e1153a1f tempest-VolumeQuotasAdminTestJSON-1582419897 None] Transfer volume completed successfully. Nov 05 03:44:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Acquiring lock "cinder-4e157e8c-9f64-4072-be9f-77e6383d727a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Lock "cinder-4e157e8c-9f64-4072-be9f-77e6383d727a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Acquiring lock "cinder-quobyte-4e157e8c-9f64-4072-be9f-77e6383d727a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Lock "cinder-quobyte-4e157e8c-9f64-4072-be9f-77e6383d727a" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:36 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca54769-7431-4d67-8e5b-028614b8304b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:36 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a Nov 05 03:44:36 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:36 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a" returned: 0 in 0.631s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:36 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a Nov 05 03:44:36 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:37 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4e157e8c-9f64-4072-be9f-77e6383d727a" returned: 0 in 0.690s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Lock "cinder-quobyte-4e157e8c-9f64-4072-be9f-77e6383d727a" released by "delete_volume" :: held 1.417s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Created reservations ['fb255988-bbcf-4899-b522-cb7b584a1bc5', '687021b2-11a8-4e72-bf3e-ab65c861d6de', '986586c0-5727-48d5-8970-8fa816cba5df', 'b12b2e39-2349-468b-a718-1a3111bf1363'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:37 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:44:37 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:38 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.759s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:38 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:38 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Deleted volume successfully. Nov 05 03:44:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e2e35e61-73c0-4004-b1e4-83215233f3c6 tempest-VolumeQuotasAdminTestJSON-1259762428 None] Lock "cinder-4e157e8c-9f64-4072-be9f-77e6383d727a-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Flow 'volume_create_manager' (22e95e2b-116d-4d67-b079-18d34abc0d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83727ec2-2f10-4890-b594-22f25fedf13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83727ec2-2f10-4890-b594-22f25fedf13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1120097790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85232eec-219d-4fa7-8340-c2525ac3fd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddea3f640e624639ae013be566ee813c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:50Z,use_quota=True,user_id='6ca35be2c8d94704837a0addc39d9c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661394ae-5c26-4de3-a01b-a19e1fd431e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661394ae-5c26-4de3-a01b-a19e1fd431e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fd110e-2a6f-498a-b7ac-507792adeb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fd110e-2a6f-498a-b7ac-507792adeb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85232eec-219d-4fa7-8340-c2525ac3fd44', 'volume_name': 'volume-85232eec-219d-4fa7-8340-c2525ac3fd44', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed953efe-d592-4671-bef6-40bd7132c625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed953efe-d592-4671-bef6-40bd7132c625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71473f8-a827-4d7c-983d-9237177175c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Volume 85232eec-219d-4fa7-8340-c2525ac3fd44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85232eec-219d-4fa7-8340-c2525ac3fd44', 'volume_size': 1} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1120097790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85232eec-219d-4fa7-8340-c2525ac3fd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddea3f640e624639ae013be566ee813c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:50Z,use_quota=True,user_id='6ca35be2c8d94704837a0addc39d9c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Creating volume 85232eec-219d-4fa7-8340-c2525ac3fd44 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:44:50 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:50 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 1073741824 Nov 05 03:44:50 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:50 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 1073741824" returned: 0 in 0.610s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:50 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 Nov 05 03:44:50 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:51 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44" returned: 0 in 0.345s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:44:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71473f8-a827-4d7c-983d-9237177175c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85232eec-219d-4fa7-8340-c2525ac3fd44', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe0fee5-104f-4dd9-a585-231b8d9b54cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:51 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Volume volume-85232eec-219d-4fa7-8340-c2525ac3fd44 (85232eec-219d-4fa7-8340-c2525ac3fd44): created successfully Nov 05 03:44:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe0fee5-104f-4dd9-a585-231b8d9b54cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Flow 'volume_create_manager' (22e95e2b-116d-4d67-b079-18d34abc0d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9b3be444-53ca-475a-81e6-4f3aaa2bb80e tempest-ServersNegativeTestJSON-437446696 None] Created volume successfully. Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Flow 'volume_create_manager' (cab5e7c5-f5a8-4cc1-91cc-ae575024624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fefdaf0-7801-48a7-9800-353d75b5f0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fefdaf0-7801-48a7-9800-353d75b5f0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2029327598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39a8359-3fc4-41f9-8009-0704e804ca72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddea3f640e624639ae013be566ee813c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:54Z,use_quota=True,user_id='6ca35be2c8d94704837a0addc39d9c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aba1d6b-a6f8-4b7e-8583-bf94d5fe7d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aba1d6b-a6f8-4b7e-8583-bf94d5fe7d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fac4c63-f748-4e31-8a9c-2b63a702dac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fac4c63-f748-4e31-8a9c-2b63a702dac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd39a8359-3fc4-41f9-8009-0704e804ca72', 'volume_name': 'volume-d39a8359-3fc4-41f9-8009-0704e804ca72', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1368f3a-9e49-42d3-b48d-4d68bfe48142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1368f3a-9e49-42d3-b48d-4d68bfe48142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e8f387-9eb0-48de-be88-30bf4fc95143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Volume d39a8359-3fc4-41f9-8009-0704e804ca72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d39a8359-3fc4-41f9-8009-0704e804ca72', 'volume_size': 1} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2029327598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39a8359-3fc4-41f9-8009-0704e804ca72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddea3f640e624639ae013be566ee813c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:54Z,use_quota=True,user_id='6ca35be2c8d94704837a0addc39d9c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Creating volume d39a8359-3fc4-41f9-8009-0704e804ca72 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:44:54 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:54 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 1073741824 Nov 05 03:44:54 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:54 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 1073741824" returned: 0 in 0.556s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:54 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 Nov 05 03:44:54 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:55 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72" returned: 0 in 0.361s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:44:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e8f387-9eb0-48de-be88-30bf4fc95143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39a8359-3fc4-41f9-8009-0704e804ca72', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b5d5ff-be56-47fc-b6e0-b7432cf395db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:55 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Volume volume-d39a8359-3fc4-41f9-8009-0704e804ca72 (d39a8359-3fc4-41f9-8009-0704e804ca72): created successfully Nov 05 03:44:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b5d5ff-be56-47fc-b6e0-b7432cf395db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Flow 'volume_create_manager' (cab5e7c5-f5a8-4cc1-91cc-ae575024624f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c05f7dde-71ce-45b2-8d38-0f97a50c1927 tempest-ServersNegativeTestJSON-437446696 None] Created volume successfully. Nov 05 03:44:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "cinder-d39a8359-3fc4-41f9-8009-0704e804ca72-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Lock "cinder-d39a8359-3fc4-41f9-8009-0704e804ca72-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "cinder-quobyte-d39a8359-3fc4-41f9-8009-0704e804ca72" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Lock "cinder-quobyte-d39a8359-3fc4-41f9-8009-0704e804ca72" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2101b6-820b-4995-92cb-135e073e96cf]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:56 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 Nov 05 03:44:56 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:57 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72" returned: 0 in 0.462s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:57 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72 Nov 05 03:44:57 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:57 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d39a8359-3fc4-41f9-8009-0704e804ca72" returned: 0 in 0.270s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Lock "cinder-quobyte-d39a8359-3fc4-41f9-8009-0704e804ca72" released by "delete_volume" :: held 0.797s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Created reservations ['90cd76d4-df81-41fa-9aa9-a43c4e7276df', '42f48686-6b78-4fcb-8ec3-72c6d2e577a7', 'e684f8ee-0d07-4933-860b-15b0c3a73900', '8068bec6-c6cc-4b14-8e36-765e3c0aaee6'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:57 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:44:57 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "cinder-85232eec-219d-4fa7-8340-c2525ac3fd44-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Lock "cinder-85232eec-219d-4fa7-8340-c2525ac3fd44-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "cinder-quobyte-85232eec-219d-4fa7-8340-c2525ac3fd44" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Lock "cinder-quobyte-85232eec-219d-4fa7-8340-c2525ac3fd44" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d11017-b254-4a28-afe2-22c0877f7be8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:58 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.436s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Deleted volume successfully. Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-112aa618-ddde-4478-a96e-1bd95ff914fb tempest-ServersNegativeTestJSON-437446696 None] Lock "cinder-d39a8359-3fc4-41f9-8009-0704e804ca72-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:58 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 Nov 05 03:44:58 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:58 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44" returned: 0 in 0.508s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:58 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44 Nov 05 03:44:58 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:58 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-85232eec-219d-4fa7-8340-c2525ac3fd44" returned: 0 in 0.313s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Lock "cinder-quobyte-85232eec-219d-4fa7-8340-c2525ac3fd44" released by "delete_volume" :: held 0.915s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Created reservations ['6ffbfa92-56b0-4260-acc6-c5cd910b5c9e', 'bc4bc9b7-cf32-4cb2-a955-8b51cbea2c8d', 'e7264b2f-1c78-4166-96a1-6de2e2b7b3f3', '4e608cad-6156-4a01-9e87-18a3d689e629'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:59 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:44:59 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:59 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.364s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Deleted volume successfully. Nov 05 03:44:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a6828319-d04f-48ca-a06f-22e849ba4b48 tempest-ServersNegativeTestJSON-437446696 None] Lock "cinder-85232eec-219d-4fa7-8340-c2525ac3fd44-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Acquiring lock "cinder-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "cinder-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Acquiring lock "cinder-quobyte-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "cinder-quobyte-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:04 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a5ea96-38b2-483c-987a-55cb46c24249]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:04 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 Nov 05 03:45:04 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:05 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058" returned: 0 in 0.463s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:05 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058 Nov 05 03:45:05 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:05 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058" returned: 0 in 0.325s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "cinder-quobyte-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058" released by "delete_volume" :: held 0.849s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Created reservations ['a2152d15-6e84-4f30-a090-7b5ae4cf799e', '26ce7ee1-6ef0-40ed-8911-c2557feec218', '874fb4f2-322d-4f7d-98df-7bd08d55e32d', 'f4dafb96-1bac-45bc-972c-24212a77985a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:05 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:05 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:06 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.367s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:06 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:06 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Deleted volume successfully. Nov 05 03:45:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4f72779d-4cb0-42e7-84db-8f0de9dd2b65 tempest-AttachVolumeShelveTestJSON-157205052 None] Lock "cinder-0abd3fa4-cb2f-48b5-af12-5eb4d78bd058-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:10 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Flow 'volume_create_manager' (f3cb9b1d-f6e8-4d08-b35d-d1566afa41e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2b3833-8576-4e4c-a801-b22a8a7edfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2b3833-8576-4e4c-a801-b22a8a7edfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-636773879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f721da2-fd0e-42e4-b63c-2d4f88af112b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1ca37e69514ade90e3691f2c130666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:11Z,use_quota=True,user_id='91075d4d52cc43a896d38d12ce9e06b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623f3281-abf1-49b9-8856-537ed1afbc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623f3281-abf1-49b9-8856-537ed1afbc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8533c29e-9300-41de-a7b9-d77cb38de1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8533c29e-9300-41de-a7b9-d77cb38de1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f721da2-fd0e-42e4-b63c-2d4f88af112b', 'volume_name': 'volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e97505-4ad8-4db2-b0cd-b25dd8249cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e97505-4ad8-4db2-b0cd-b25dd8249cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad4c1a6-506a-4e2a-807a-79e1f6c1703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:11 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Volume 3f721da2-fd0e-42e4-b63c-2d4f88af112b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b', 'volume_size': 1} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-636773879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f721da2-fd0e-42e4-b63c-2d4f88af112b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1ca37e69514ade90e3691f2c130666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:11Z,use_quota=True,user_id='91075d4d52cc43a896d38d12ce9e06b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Creating volume 3f721da2-fd0e-42e4-b63c-2d4f88af112b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:11 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:11 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b 1073741824 Nov 05 03:45:11 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:11 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b 1073741824" returned: 0 in 0.743s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:11 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b Nov 05 03:45:11 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:12 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b" returned: 0 in 0.502s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad4c1a6-506a-4e2a-807a-79e1f6c1703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dda9eb-6fc0-4e59-bb9f-2fc2a7c38646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Volume volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b (3f721da2-fd0e-42e4-b63c-2d4f88af112b): created successfully Nov 05 03:45:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dda9eb-6fc0-4e59-bb9f-2fc2a7c38646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Flow 'volume_create_manager' (f3cb9b1d-f6e8-4d08-b35d-d1566afa41e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:12 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ec0be5ce-b2be-4ce6-9af5-64d00cdd052f tempest-ServerActionsTestOtherA-1758953836 None] Created volume successfully. Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Flow 'volume_create_manager' (f0a539ef-9623-4cfb-b91f-88838c607b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a473d62a-d0bf-4c24-91ac-b9dba9924436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a473d62a-d0bf-4c24-91ac-b9dba9924436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2075908543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819daac3-b0a0-4c42-9308-a48ec50acde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd7ef51e5b746e7b06c5bdd361531b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:14Z,use_quota=True,user_id='a983ce5414cb4563a6fb13e0e7d2adfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be72f17-748d-437f-be90-dc522f158fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be72f17-748d-437f-be90-dc522f158fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2016cae5-d888-4ae6-adbb-dc3bedf4c6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2016cae5-d888-4ae6-adbb-dc3bedf4c6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819daac3-b0a0-4c42-9308-a48ec50acde3', 'volume_name': 'volume-819daac3-b0a0-4c42-9308-a48ec50acde3', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640592b7-9e92-490d-a340-f2722cd8c127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640592b7-9e92-490d-a340-f2722cd8c127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf77e311-771b-4fab-a633-1747cf880f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:13 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Volume 819daac3-b0a0-4c42-9308-a48ec50acde3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819daac3-b0a0-4c42-9308-a48ec50acde3', 'volume_size': 1} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2075908543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819daac3-b0a0-4c42-9308-a48ec50acde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd7ef51e5b746e7b06c5bdd361531b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:14Z,use_quota=True,user_id='a983ce5414cb4563a6fb13e0e7d2adfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Creating volume 819daac3-b0a0-4c42-9308-a48ec50acde3 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:13 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:14 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 1073741824 Nov 05 03:45:14 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Flow 'volume_create_manager' (f9908afb-d9f4-4ea1-865e-99298a76aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a8ba79-61e0-4288-801f-ded771c22929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a8ba79-61e0-4288-801f-ded771c22929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-563431878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cc4dd35e3da44e2932a0811145495dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:14Z,use_quota=True,user_id='a03007831b1f409b8b14297d70dd3665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd31554-84a8-4fc1-af38-9c03bd769bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd31554-84a8-4fc1-af38-9c03bd769bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd07ef0b-dbe2-47c3-8524-354070c7e995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd07ef0b-dbe2-47c3-8524-354070c7e995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2', 'volume_name': 'volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955f7365-f793-4493-a193-95a71b7cc739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955f7365-f793-4493-a193-95a71b7cc739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e063df0-59b3-46da-9be3-0e36cf922fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:14 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Volume ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2', 'volume_size': 1} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:14 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 1073741824" returned: 0 in 0.668s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:14 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 Nov 05 03:45:14 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:15 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3" returned: 0 in 0.309s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-563431878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cc4dd35e3da44e2932a0811145495dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:14Z,use_quota=True,user_id='a03007831b1f409b8b14297d70dd3665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Creating volume ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:15 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf77e311-771b-4fab-a633-1747cf880f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819daac3-b0a0-4c42-9308-a48ec50acde3', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:15 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 1073741824 Nov 05 03:45:15 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ff56d0-01d0-43f1-8c25-4b1b96107df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:15 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Volume volume-819daac3-b0a0-4c42-9308-a48ec50acde3 (819daac3-b0a0-4c42-9308-a48ec50acde3): created successfully Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ff56d0-01d0-43f1-8c25-4b1b96107df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Flow 'volume_create_manager' (f0a539ef-9623-4cfb-b91f-88838c607b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7dfa3bff-8b72-4cf4-a4e0-7606b88def7e tempest-VolumesListAdminTestJSON-321887381 None] Created volume successfully. Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:15 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:15 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:15 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.342s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 8 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:45:15 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 1073741824" returned: 0 in 0.616s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:15 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 Nov 05 03:45:15 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:16 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e063df0-59b3-46da-9be3-0e36cf922fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbf1c04-089f-4d4c-be87-d13553650b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:16 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Volume volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 (ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2): created successfully Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbf1c04-089f-4d4c-be87-d13553650b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Flow 'volume_create_manager' (f9908afb-d9f4-4ea1-865e-99298a76aed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:16 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-3daf5c41-d79b-42f3-9272-330a89ff7d78 req-eec1eeeb-08d7-4d06-98e9-b2b487782787 tempest-VolumesGetTestJSON-2033393406 None] Created volume successfully. Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Flow 'volume_create_manager' (2b8f27c1-4cd5-4696-90c6-9465ce7b4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5af452b-d115-43dc-96e5-d2ac7aa52152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5af452b-d115-43dc-96e5-d2ac7aa52152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1720634984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367736fa-fcff-49e7-b0c9-7663e25e9798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd7ef51e5b746e7b06c5bdd361531b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:17Z,use_quota=True,user_id='a983ce5414cb4563a6fb13e0e7d2adfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ded44fc-77a1-4523-9c38-9ac055306f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ded44fc-77a1-4523-9c38-9ac055306f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c899619-2399-4463-a4c9-2fc44c7f4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c899619-2399-4463-a4c9-2fc44c7f4144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '367736fa-fcff-49e7-b0c9-7663e25e9798', 'volume_name': 'volume-367736fa-fcff-49e7-b0c9-7663e25e9798', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba568a2-0e95-4283-a8bb-b1f51ce65959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba568a2-0e95-4283-a8bb-b1f51ce65959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9589acb8-a9e1-4039-abee-a74a932c9270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:16 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Volume 367736fa-fcff-49e7-b0c9-7663e25e9798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-367736fa-fcff-49e7-b0c9-7663e25e9798', 'volume_size': 1} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1720634984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367736fa-fcff-49e7-b0c9-7663e25e9798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd7ef51e5b746e7b06c5bdd361531b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:17Z,use_quota=True,user_id='a983ce5414cb4563a6fb13e0e7d2adfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Creating volume 367736fa-fcff-49e7-b0c9-7663e25e9798 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:16 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:16 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 1073741824 Nov 05 03:45:16 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Acquiring lock "cinder-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Lock "cinder-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Acquiring lock "cinder-quobyte-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Lock "cinder-quobyte-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2" acquired by "delete_volume" :: waited 0.045s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:17 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2e1f69-7aa4-4433-93da-3b0ec5e8d2f4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:17 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 1073741824" returned: 0 in 0.902s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:17 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 Nov 05 03:45:17 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:17 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 Nov 05 03:45:17 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:18 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2" returned: 0 in 0.560s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:18 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2 Nov 05 03:45:18 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:18 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798" returned: 0 in 0.498s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9589acb8-a9e1-4039-abee-a74a932c9270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367736fa-fcff-49e7-b0c9-7663e25e9798', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0f638-bd69-4b5d-9e37-98ea6dff700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:18 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Volume volume-367736fa-fcff-49e7-b0c9-7663e25e9798 (367736fa-fcff-49e7-b0c9-7663e25e9798): created successfully Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0f638-bd69-4b5d-9e37-98ea6dff700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Flow 'volume_create_manager' (2b8f27c1-4cd5-4696-90c6-9465ce7b4103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-34335862-d24f-444b-ae95-da8a61c198d5 tempest-VolumesListAdminTestJSON-321887381 None] Created volume successfully. Nov 05 03:45:18 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2" returned: 0 in 0.398s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Lock "cinder-quobyte-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2" released by "delete_volume" :: held 1.052s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.quota [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Created reservations ['e435019e-96bc-4ef3-b708-0f19a670d75e', '8b97e1ec-a28d-4626-a485-1a5fe9b5d417', '4b8ff53c-3547-47b6-944b-dba50c122d94', 'a7ad0900-5a4e-4d81-949e-62a7ffba46f7'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:18 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:18 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:19 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.317s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.manager [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:19 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Deleted volume successfully. Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-2c62cf7e-7397-406a-a0e9-0745734c7849 req-ec4b2202-71e7-4505-924f-05e5e2004474 tempest-VolumesGetTestJSON-2033393406 None] Lock "cinder-ccdfd8cf-5bb2-4aaa-9448-0dffa46e06d2-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Flow 'volume_create_manager' (4d6adc13-d5d8-4895-b4e3-ac1e4c626c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b878a1ff-a8a6-4d3e-9dd6-522a8ac44a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b878a1ff-a8a6-4d3e-9dd6-522a8ac44a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-76657567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7cdd86-dce8-48de-bf30-04ffbb380182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd7ef51e5b746e7b06c5bdd361531b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:19Z,use_quota=True,user_id='a983ce5414cb4563a6fb13e0e7d2adfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3bc442-4686-4173-b87d-35a66654b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3bc442-4686-4173-b87d-35a66654b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b846c182-431f-4e50-82fe-0ce8ca3e9625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b846c182-431f-4e50-82fe-0ce8ca3e9625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7cdd86-dce8-48de-bf30-04ffbb380182', 'volume_name': 'volume-ae7cdd86-dce8-48de-bf30-04ffbb380182', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9922773e-9e96-4dd7-9c38-febf99b8b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9922773e-9e96-4dd7-9c38-febf99b8b044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f8121c-5ed7-48db-9381-d3de31ae43bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:19 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Volume ae7cdd86-dce8-48de-bf30-04ffbb380182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7cdd86-dce8-48de-bf30-04ffbb380182', 'volume_size': 1} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-76657567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7cdd86-dce8-48de-bf30-04ffbb380182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd7ef51e5b746e7b06c5bdd361531b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:19Z,use_quota=True,user_id='a983ce5414cb4563a6fb13e0e7d2adfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Creating volume ae7cdd86-dce8-48de-bf30-04ffbb380182 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:19 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:19 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 1073741824 Nov 05 03:45:19 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:20 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 1073741824" returned: 0 in 0.654s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=51,cinder:UPDATE=66,cinder:INSERT=15,cinder:DELETE=9 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:20 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 Nov 05 03:45:20 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:20 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182" returned: 0 in 0.378s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=59,cinder:UPDATE=83,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f8121c-5ed7-48db-9381-d3de31ae43bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7cdd86-dce8-48de-bf30-04ffbb380182', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841184b4-ba24-4dea-8c27-44f72040d2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Volume volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 (ae7cdd86-dce8-48de-bf30-04ffbb380182): created successfully Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841184b4-ba24-4dea-8c27-44f72040d2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Flow 'volume_create_manager' (4d6adc13-d5d8-4895-b4e3-ac1e4c626c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-560a7724-0942-42e6-b188-02fe097d7c7f tempest-VolumesListAdminTestJSON-321887381 None] Created volume successfully. Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Flow 'volume_create_manager' (0ea66fd3-d22e-4bb1-b41c-ba2d6be9f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77b1876-924d-4605-a84d-b2b3e0010f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77b1876-924d-4605-a84d-b2b3e0010f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf260c9-5363-4159-b890-26cdb7c1f6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb77ea313e1e4e638d6d9cbe6389122c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:23Z,use_quota=True,user_id='40f720e5004d4f2c86b98f61f97f308f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7018c3bd-3c82-4216-a530-1b0393158783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7018c3bd-3c82-4216-a530-1b0393158783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a384a604-71e8-49ac-b3c3-45336c9f599a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a384a604-71e8-49ac-b3c3-45336c9f599a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf260c9-5363-4159-b890-26cdb7c1f6b4', 'volume_name': 'volume-baf260c9-5363-4159-b890-26cdb7c1f6b4', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67a6260-9558-4bfb-b7f2-52e09a821fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67a6260-9558-4bfb-b7f2-52e09a821fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef01dd4-1da9-4bce-8fd1-61b26cdfc77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:23 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Volume baf260c9-5363-4159-b890-26cdb7c1f6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf260c9-5363-4159-b890-26cdb7c1f6b4', 'volume_size': 1} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf260c9-5363-4159-b890-26cdb7c1f6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb77ea313e1e4e638d6d9cbe6389122c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:23Z,use_quota=True,user_id='40f720e5004d4f2c86b98f61f97f308f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Creating volume baf260c9-5363-4159-b890-26cdb7c1f6b4 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:23 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:23 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 1073741824 Nov 05 03:45:23 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:24 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 1073741824" returned: 0 in 0.878s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:24 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 Nov 05 03:45:24 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:25 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4" returned: 0 in 0.576s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef01dd4-1da9-4bce-8fd1-61b26cdfc77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf260c9-5363-4159-b890-26cdb7c1f6b4', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563758fc-ad64-4547-8fcc-ea087f2e4162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:25 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Volume volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 (baf260c9-5363-4159-b890-26cdb7c1f6b4): created successfully Nov 05 03:45:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563758fc-ad64-4547-8fcc-ea087f2e4162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Flow 'volume_create_manager' (0ea66fd3-d22e-4bb1-b41c-ba2d6be9f923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:25 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ce3c4e05-e6e3-413b-b7c0-a9c31e967a79 tempest-VolumesListAdminTestJSON-1690448273 None] Created volume successfully. Nov 05 03:45:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Acquiring lock "cinder-baf260c9-5363-4159-b890-26cdb7c1f6b4-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "cinder-baf260c9-5363-4159-b890-26cdb7c1f6b4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:26 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Flow 'volume_create_manager' (bf5e8ff2-23d1-4153-8ab5-5d43f6ed17d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944aa45b-6e9d-4e45-9b3e-474d3bb79fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Acquiring lock "cinder-quobyte-baf260c9-5363-4159-b890-26cdb7c1f6b4" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944aa45b-6e9d-4e45-9b3e-474d3bb79fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2072770752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d97019-c5c8-4731-b953-2a564f582a70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36fb674be37c442f826e169e86e53159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:27Z,use_quota=True,user_id='67ef29d4f28d4a62adf4f6c97b1d2c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9913bd89-07a7-4955-b89d-9eb5de6d530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9913bd89-07a7-4955-b89d-9eb5de6d530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2431fe79-5beb-4bcf-9ff5-e26631b27f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2431fe79-5beb-4bcf-9ff5-e26631b27f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d97019-c5c8-4731-b953-2a564f582a70', 'volume_name': 'volume-42d97019-c5c8-4731-b953-2a564f582a70', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3b9400-3122-4f19-b4c6-5f8fd7a63b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3b9400-3122-4f19-b4c6-5f8fd7a63b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa03b4a-325b-41c0-8bb3-e4d69a099fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:27 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Volume 42d97019-c5c8-4731-b953-2a564f582a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d97019-c5c8-4731-b953-2a564f582a70', 'volume_size': 1} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2072770752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d97019-c5c8-4731-b953-2a564f582a70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36fb674be37c442f826e169e86e53159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:27Z,use_quota=True,user_id='67ef29d4f28d4a62adf4f6c97b1d2c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Creating volume 42d97019-c5c8-4731-b953-2a564f582a70 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:27 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "cinder-quobyte-baf260c9-5363-4159-b890-26cdb7c1f6b4" acquired by "delete_volume" :: waited 0.178s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:27 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 1073741824 Nov 05 03:45:27 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "cinder-ae7cdd86-dce8-48de-bf30-04ffbb380182-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b518c79-2634-445b-bab4-9c1e5c8f7b78]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-ae7cdd86-dce8-48de-bf30-04ffbb380182-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "cinder-quobyte-ae7cdd86-dce8-48de-bf30-04ffbb380182" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-quobyte-ae7cdd86-dce8-48de-bf30-04ffbb380182" acquired by "delete_volume" :: waited 0.034s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:27 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 Nov 05 03:45:27 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7dbd8d-f13b-4d16-a9f1-aff3631d20ea]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:27 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 1073741824" returned: 0 in 0.686s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:27 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 Nov 05 03:45:27 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:27 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 Nov 05 03:45:27 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:28 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4" returned: 0 in 0.787s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:28 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4 Nov 05 03:45:28 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:28 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70" returned: 0 in 0.475s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa03b4a-325b-41c0-8bb3-e4d69a099fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d97019-c5c8-4731-b953-2a564f582a70', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b856e736-47f4-47cb-86f7-5916c66c96e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:28 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Volume volume-42d97019-c5c8-4731-b953-2a564f582a70 (42d97019-c5c8-4731-b953-2a564f582a70): created successfully Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b856e736-47f4-47cb-86f7-5916c66c96e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Flow 'volume_create_manager' (bf5e8ff2-23d1-4153-8ab5-5d43f6ed17d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-71163926-d7b3-4b8c-a866-af18509a86f6 tempest-VolumesTestJSON-1257863583 None] Created volume successfully. Nov 05 03:45:28 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182" returned: 0 in 1.130s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:28 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-baf260c9-5363-4159-b890-26cdb7c1f6b4" returned: 0 in 0.617s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:28 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182 Nov 05 03:45:28 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "cinder-quobyte-baf260c9-5363-4159-b890-26cdb7c1f6b4" released by "delete_volume" :: held 1.518s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Created reservations ['cfe516b3-a9fd-4fc6-914b-c3505ba17897', '489a0dc3-aa50-482b-ba46-21661eb858e7', '101921db-5ce5-4547-a947-a170b2607fb1', 'feb68b39-899d-4325-8d00-a7c16e283ff0'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:29 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:29 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:29 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ae7cdd86-dce8-48de-bf30-04ffbb380182" returned: 0 in 0.527s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-quobyte-ae7cdd86-dce8-48de-bf30-04ffbb380182" released by "delete_volume" :: held 1.774s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:29 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.385s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Deleted volume successfully. Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Created reservations ['ac90e742-746d-4067-93ff-f32ae5723ef0', '12779ac3-a641-41a7-96d7-4dd05fa89604', '7eb0a9c6-eff3-4b54-b40e-b58829c5563e', 'f6ad9212-d2eb-4a80-a4df-f471413ed83d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-70df5484-857b-491f-b51a-afb2ebe88030 tempest-VolumesListAdminTestJSON-1690448273 None] Lock "cinder-baf260c9-5363-4159-b890-26cdb7c1f6b4-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:29 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:29 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:29 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.337s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Deleted volume successfully. Nov 05 03:45:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d08f13d-accb-4c6d-81be-cab40d3a6f9d tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-ae7cdd86-dce8-48de-bf30-04ffbb380182-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Flow 'volume_create_manager' (0c3f6dca-5d69-4164-8dd5-98469a5a39af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9fb7f0-9e02-45fc-b754-c93bf83e1ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9fb7f0-9e02-45fc-b754-c93bf83e1ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1022920597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a022cd-ebc0-42f2-a74e-79e2366d4282,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36fb674be37c442f826e169e86e53159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:30Z,use_quota=True,user_id='67ef29d4f28d4a62adf4f6c97b1d2c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6617ef86-2ba5-4926-908b-9fef3b8e9c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6617ef86-2ba5-4926-908b-9fef3b8e9c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a50fd6-9bd2-4c78-b30c-56cd993a2d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a50fd6-9bd2-4c78-b30c-56cd993a2d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a022cd-ebc0-42f2-a74e-79e2366d4282', 'volume_name': 'volume-71a022cd-ebc0-42f2-a74e-79e2366d4282', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe2c4c0-16d6-4522-bbba-8ae5ebb9956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe2c4c0-16d6-4522-bbba-8ae5ebb9956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efeec19-987e-4678-88ae-795fa9f846ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:30 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Volume 71a022cd-ebc0-42f2-a74e-79e2366d4282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a022cd-ebc0-42f2-a74e-79e2366d4282', 'volume_size': 1} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1022920597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a022cd-ebc0-42f2-a74e-79e2366d4282,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36fb674be37c442f826e169e86e53159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:30Z,use_quota=True,user_id='67ef29d4f28d4a62adf4f6c97b1d2c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Creating volume 71a022cd-ebc0-42f2-a74e-79e2366d4282 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:30 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:30 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 1073741824 Nov 05 03:45:30 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "cinder-367736fa-fcff-49e7-b0c9-7663e25e9798-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-367736fa-fcff-49e7-b0c9-7663e25e9798-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "cinder-quobyte-367736fa-fcff-49e7-b0c9-7663e25e9798" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-quobyte-367736fa-fcff-49e7-b0c9-7663e25e9798" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c17917d-8b01-4b95-aed9-38d05e1cfea1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:31 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 Nov 05 03:45:31 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:31 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798" returned: 0 in 0.582s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:31 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798 Nov 05 03:45:31 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:31 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 1073741824" returned: 0 in 1.108s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:31 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 Nov 05 03:45:31 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:31 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-367736fa-fcff-49e7-b0c9-7663e25e9798" returned: 0 in 0.489s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-quobyte-367736fa-fcff-49e7-b0c9-7663e25e9798" released by "delete_volume" :: held 1.151s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Created reservations ['75704357-4dbd-4484-b2f3-917fc559c3bb', '70402a50-9518-4f3f-b736-5d1181be6453', '371cfb0f-957f-45cb-afb3-ad00861902b8', '8c72a8b2-475b-41d4-b7fc-bc5f57dbc5ae'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:32 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:32 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:32 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282" returned: 0 in 0.629s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efeec19-987e-4678-88ae-795fa9f846ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a022cd-ebc0-42f2-a74e-79e2366d4282', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfda456-658d-4155-9f1d-3231150059c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:32 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Volume volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 (71a022cd-ebc0-42f2-a74e-79e2366d4282): created successfully Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfda456-658d-4155-9f1d-3231150059c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Flow 'volume_create_manager' (0c3f6dca-5d69-4164-8dd5-98469a5a39af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-47e0f4f6-bd24-4f85-9140-7609d2427d8f tempest-VolumesTestJSON-1257863583 None] Created volume successfully. Nov 05 03:45:32 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Deleted volume successfully. Nov 05 03:45:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-359affe7-3480-4a6c-8419-e85c010343c3 tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-367736fa-fcff-49e7-b0c9-7663e25e9798-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "cinder-819daac3-b0a0-4c42-9308-a48ec50acde3-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-819daac3-b0a0-4c42-9308-a48ec50acde3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "cinder-quobyte-819daac3-b0a0-4c42-9308-a48ec50acde3" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-quobyte-819daac3-b0a0-4c42-9308-a48ec50acde3" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:33 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e309f8ff-c39d-4f56-8ea9-99ff2aad0f17]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:33 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 Nov 05 03:45:33 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:33 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3" returned: 0 in 0.518s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:33 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3 Nov 05 03:45:33 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:34 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-819daac3-b0a0-4c42-9308-a48ec50acde3" returned: 0 in 0.390s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-quobyte-819daac3-b0a0-4c42-9308-a48ec50acde3" released by "delete_volume" :: held 1.007s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Created reservations ['cf1f4fcd-df6e-4f81-8513-5032a8b79181', '10a21e4d-779c-4fcd-9fe9-d629a2e0797e', '09e213e5-56ef-4949-b005-76117e6d3d85', '7ef4de9e-4a4b-4c0c-be02-4122fa470154'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:34 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:34 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Flow 'volume_create_manager' (c0891c55-1949-42a2-8151-664a3995282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab426c1f-66df-4718-a492-98f7ef11aeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab426c1f-66df-4718-a492-98f7ef11aeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-144589100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fce4e2-d385-4fb8-95db-78db1bdf91ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36fb674be37c442f826e169e86e53159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:35Z,use_quota=True,user_id='67ef29d4f28d4a62adf4f6c97b1d2c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcb5f44-8e56-4fa1-ad1a-71a6fa05ca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcb5f44-8e56-4fa1-ad1a-71a6fa05ca6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0c0579-5f97-4cf5-8288-745c16f844cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0c0579-5f97-4cf5-8288-745c16f844cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20fce4e2-d385-4fb8-95db-78db1bdf91ce', 'volume_name': 'volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8640030-25b6-4500-a039-567be42b01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:34 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8640030-25b6-4500-a039-567be42b01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182fdb58-48ab-43b1-a502-3905c1da311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:34 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Volume 20fce4e2-d385-4fb8-95db-78db1bdf91ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce', 'volume_size': 1} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-144589100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fce4e2-d385-4fb8-95db-78db1bdf91ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36fb674be37c442f826e169e86e53159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:35Z,use_quota=True,user_id='67ef29d4f28d4a62adf4f6c97b1d2c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Creating volume 20fce4e2-d385-4fb8-95db-78db1bdf91ce {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:34 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.345s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:34 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:34 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce 1073741824 Nov 05 03:45:34 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:34 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Deleted volume successfully. Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6263e47d-e701-4880-a89c-91b556b2816f tempest-VolumesListAdminTestJSON-321887381 None] Lock "cinder-819daac3-b0a0-4c42-9308-a48ec50acde3-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:35 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce 1073741824" returned: 0 in 0.621s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:35 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce Nov 05 03:45:35 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:35 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce" returned: 0 in 0.314s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182fdb58-48ab-43b1-a502-3905c1da311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7f17ab-bff9-4026-92b4-aedbb944a580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:35 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Volume volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce (20fce4e2-d385-4fb8-95db-78db1bdf91ce): created successfully Nov 05 03:45:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7f17ab-bff9-4026-92b4-aedbb944a580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Flow 'volume_create_manager' (c0891c55-1949-42a2-8151-664a3995282e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:36 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-78d09d96-f84e-48ad-aea9-504c8faa5106 tempest-VolumesTestJSON-1257863583 None] Created volume successfully. Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "cinder-20fce4e2-d385-4fb8-95db-78db1bdf91ce-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-20fce4e2-d385-4fb8-95db-78db1bdf91ce-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "cinder-quobyte-20fce4e2-d385-4fb8-95db-78db1bdf91ce" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-quobyte-20fce4e2-d385-4fb8-95db-78db1bdf91ce" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ff6a99-edcb-4e41-a1af-9dfae4c85244]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:38 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce Nov 05 03:45:38 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:38 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce" returned: 0 in 0.406s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:38 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce Nov 05 03:45:38 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:38 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-20fce4e2-d385-4fb8-95db-78db1bdf91ce" returned: 0 in 0.317s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-quobyte-20fce4e2-d385-4fb8-95db-78db1bdf91ce" released by "delete_volume" :: held 0.799s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Created reservations ['48a75702-7c86-40ad-bfba-2c33dee63040', 'f19c0b11-979a-4db1-8b7b-0b9033e26b92', 'ddd08953-f5eb-4747-9d97-8c8292816313', 'b05d2b28-ccc7-462c-b58d-ed996c870682'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:39 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:39 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "cinder-71a022cd-ebc0-42f2-a74e-79e2366d4282-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-71a022cd-ebc0-42f2-a74e-79e2366d4282-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "cinder-quobyte-71a022cd-ebc0-42f2-a74e-79e2366d4282" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-quobyte-71a022cd-ebc0-42f2-a74e-79e2366d4282" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:39 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.321s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1656426c-9b2f-4d48-84fb-5e416ad3c7e9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Deleted volume successfully. Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-57853044-5434-4b21-a682-5e13ae10bc48 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-20fce4e2-d385-4fb8-95db-78db1bdf91ce-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:39 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 Nov 05 03:45:39 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:39 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282" returned: 0 in 0.466s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:39 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282 Nov 05 03:45:39 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:40 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-71a022cd-ebc0-42f2-a74e-79e2366d4282" returned: 0 in 0.307s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-quobyte-71a022cd-ebc0-42f2-a74e-79e2366d4282" released by "delete_volume" :: held 0.840s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Created reservations ['eebeb7ea-a19a-4030-881b-1784514194fa', 'f592f44b-8ab2-4faf-9662-0e58ad4d5da5', '1aa4d23c-6f42-4ab1-bb5d-40130dc54901', 'de0da747-f42e-43a3-9acd-ebac863fc0c6'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:40 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:40 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "cinder-42d97019-c5c8-4731-b953-2a564f582a70-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-42d97019-c5c8-4731-b953-2a564f582a70-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "cinder-quobyte-42d97019-c5c8-4731-b953-2a564f582a70" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-quobyte-42d97019-c5c8-4731-b953-2a564f582a70" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[44686668-ba0d-4404-80ff-42475cca5622]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:40 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.391s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:40 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Deleted volume successfully. Nov 05 03:45:40 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 Nov 05 03:45:40 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-334eaaab-55cd-4669-a127-381a83b88ac6 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-71a022cd-ebc0-42f2-a74e-79e2366d4282-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:41 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70" returned: 0 in 0.539s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:41 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70 Nov 05 03:45:41 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:41 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42d97019-c5c8-4731-b953-2a564f582a70" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-quobyte-42d97019-c5c8-4731-b953-2a564f582a70" released by "delete_volume" :: held 0.910s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Created reservations ['4a073ea9-6f7b-48a2-8d02-868c208e1d99', 'c2e679dd-4d4b-4f11-a515-7aebf7abd048', '22769745-51b5-4aa6-867c-c1e629b2be67', '5b318b8f-2d96-4313-a942-a54d867518bc'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:41 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:41 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:42 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.355s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:42 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:42 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Deleted volume successfully. Nov 05 03:45:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-040c7ad7-8784-474c-a0aa-d0f40e3ff2f9 tempest-VolumesTestJSON-1257863583 None] Lock "cinder-42d97019-c5c8-4731-b953-2a564f582a70-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a01a9011-8bbd-477d-851e-bb8e3ad093fe tempest-GroupSnapshotsV319Test-771750642 None] Group tempest-GroupSnapshotsV319Test-Group-1008453237: creating Nov 05 03:45:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a01a9011-8bbd-477d-851e-bb8e3ad093fe tempest-GroupSnapshotsV319Test-771750642 None] Group tempest-GroupSnapshotsV319Test-Group-1008453237: created successfully Nov 05 03:45:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a01a9011-8bbd-477d-851e-bb8e3ad093fe tempest-GroupSnapshotsV319Test-771750642 None] Create group completed successfully. Nov 05 03:45:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-dc602002-80e0-4634-a241-9c36b05d5526 req-7cf6dea5-2849-4d79-8d10-1d39d69aecaf tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-dc602002-80e0-4634-a241-9c36b05d5526 req-7cf6dea5-2849-4d79-8d10-1d39d69aecaf tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-dc602002-80e0-4634-a241-9c36b05d5526 req-7cf6dea5-2849-4d79-8d10-1d39d69aecaf tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-dc602002-80e0-4634-a241-9c36b05d5526 req-7cf6dea5-2849-4d79-8d10-1d39d69aecaf tempest-ServerActionsTestOtherA-1758953836 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23411363-f0f5-49e9-9461-a26eea395c36', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:45:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-dc602002-80e0-4634-a241-9c36b05d5526 req-7cf6dea5-2849-4d79-8d10-1d39d69aecaf tempest-ServerActionsTestOtherA-1758953836 None] attachment_update completed successfully. Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Flow 'volume_create_manager' (35a61f5c-8119-4079-a36e-ab7c6b3a8499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a25b6ff-84e0-44b8-af16-90da437e1635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a25b6ff-84e0-44b8-af16-90da437e1635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481858130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15c30a9-894c-4242-b359-bf31c3074021,host='devstack@QuobyteHD#QuobyteHD',id=60d29884-4cd9-449c-a76c-3ef7e76fddc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066048c4ae0544ee8d4f88fa8aa53d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:53Z,use_quota=True,user_id='4d54b870bbb34d6bb14470fe3cdcb426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(631fce35-2227-4451-92c8-2efc48027a49),volume_type_id=631fce35-2227-4451-92c8-2efc48027a49)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef990b9-073f-4ec6-a484-05b42252b64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef990b9-073f-4ec6-a484-05b42252b64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85213dc6-3ffd-42bd-99e7-c608c45dc591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85213dc6-3ffd-42bd-99e7-c608c45dc591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d29884-4cd9-449c-a76c-3ef7e76fddc4', 'volume_name': 'volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17903ee-e35d-45a1-a58d-60be905fc24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17903ee-e35d-45a1-a58d-60be905fc24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5211bc-1903-4f5e-b320-9535070ec8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Volume 60d29884-4cd9-449c-a76c-3ef7e76fddc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4', 'volume_size': 1} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f15c30a9-894c-4242-b359-bf31c3074021,created_at=2026-11-05T02:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481858130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15c30a9-894c-4242-b359-bf31c3074021,host='devstack@QuobyteHD#QuobyteHD',id=60d29884-4cd9-449c-a76c-3ef7e76fddc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066048c4ae0544ee8d4f88fa8aa53d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:53Z,use_quota=True,user_id='4d54b870bbb34d6bb14470fe3cdcb426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(631fce35-2227-4451-92c8-2efc48027a49),volume_type_id=631fce35-2227-4451-92c8-2efc48027a49)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Creating volume 60d29884-4cd9-449c-a76c-3ef7e76fddc4 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:53 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:53 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 1073741824 Nov 05 03:45:53 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Flow 'volume_create_manager' (924379b2-6b9d-4df2-8d82-a24e69159f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08af25-d7df-4575-9f77-efc9619a5aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08af25-d7df-4575-9f77-efc9619a5aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1836454511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836c6ebf-e782-4abb-9150-8e5275de4a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c92fcd1f14b4fd48c8bda9adf999a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:54Z,use_quota=True,user_id='434a6c4ba5ff42ffa66ffb8abbcdf0bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf81606e-3922-4a39-8650-d0d276ad5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf81606e-3922-4a39-8650-d0d276ad5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6ab1c3-cde5-45a4-acd2-bc5b293712c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6ab1c3-cde5-45a4-acd2-bc5b293712c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836c6ebf-e782-4abb-9150-8e5275de4a5f', 'volume_name': 'volume-836c6ebf-e782-4abb-9150-8e5275de4a5f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fd9fe1-c571-46a4-a427-698fc48f9bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fd9fe1-c571-46a4-a427-698fc48f9bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d54f6a-78e4-4c18-ae25-b34adffdd456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Volume 836c6ebf-e782-4abb-9150-8e5275de4a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836c6ebf-e782-4abb-9150-8e5275de4a5f', 'volume_size': 1} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:53 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 1073741824" returned: 0 in 0.555s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:54 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 Nov 05 03:45:54 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:54 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4" returned: 0 in 0.246s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1836454511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836c6ebf-e782-4abb-9150-8e5275de4a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c92fcd1f14b4fd48c8bda9adf999a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:54Z,use_quota=True,user_id='434a6c4ba5ff42ffa66ffb8abbcdf0bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Creating volume 836c6ebf-e782-4abb-9150-8e5275de4a5f {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:54 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5211bc-1903-4f5e-b320-9535070ec8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b9044a-c53a-4873-877c-7b842b0a736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:54 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f 1073741824 Nov 05 03:45:54 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Volume volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 (60d29884-4cd9-449c-a76c-3ef7e76fddc4): created successfully Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b9044a-c53a-4873-877c-7b842b0a736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Flow 'volume_create_manager' (35a61f5c-8119-4079-a36e-ab7c6b3a8499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:54 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b4f599cc-9a4e-4c74-bffe-73478c8ff0f7 tempest-GroupSnapshotsV319Test-771750642 None] Created volume successfully. Nov 05 03:45:54 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f 1073741824" returned: 0 in 0.587s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:54 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f Nov 05 03:45:54 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] GroupSnapshot 9df7b0af-da91-438d-9fb0-44e8779414f3: creating. Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Group snapshot 9df7b0af-da91-438d-9fb0-44e8779414f3: creating. {{(pid=87111) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:55 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f" returned: 0 in 0.424s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d54f6a-78e4-4c18-ae25-b34adffdd456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836c6ebf-e782-4abb-9150-8e5275de4a5f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d405b1fb-ab48-46f9-9e63-f61ca02b6069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Creating offline snapshot 55435b4d-8ce8-4f61-a516-b3237b2b34fa of volume 60d29884-4cd9-449c-a76c-3ef7e76fddc4 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:45:55 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Volume volume-836c6ebf-e782-4abb-9150-8e5275de4a5f (836c6ebf-e782-4abb-9150-8e5275de4a5f): created successfully Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d405b1fb-ab48-46f9-9e63-f61ca02b6069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Flow 'volume_create_manager' (924379b2-6b9d-4df2-8d82-a24e69159f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd1a02-d806-400c-ae4a-69b732998fee]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0de2c8da-463a-4580-8e8a-3bba8d2b2ec0 tempest-VolumesMetadataTest-798207233 None] Created volume successfully. Nov 05 03:45:55 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 Nov 05 03:45:55 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:55 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4" returned: 0 in 0.527s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:55 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa 1G Nov 05 03:45:55 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:56 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa 1G" returned: 0 in 0.711s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:56 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa Nov 05 03:45:56 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-fdf49354-1b35-4106-be2e-8dad830af184 req-f98bec1a-2eed-46f6-b495-c9c9e4527099 tempest-ServerActionsTestOtherA-1758953836 None] Terminate volume connection completed successfully. Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-fdf49354-1b35-4106-be2e-8dad830af184 req-f98bec1a-2eed-46f6-b495-c9c9e4527099 tempest-ServerActionsTestOtherA-1758953836 None] Deleting attachment 23411363-f0f5-49e9-9461-a26eea395c36. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:45:57 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa" returned: 0 in 0.479s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:57 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:57 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa Nov 05 03:45:57 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Acquiring lock "cinder-836c6ebf-e782-4abb-9150-8e5275de4a5f-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Lock "cinder-836c6ebf-e782-4abb-9150-8e5275de4a5f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Acquiring lock "cinder-quobyte-836c6ebf-e782-4abb-9150-8e5275de4a5f" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Lock "cinder-quobyte-836c6ebf-e782-4abb-9150-8e5275de4a5f" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67db04b-060c-44cd-82b3-2ad8dac0e6ff]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:57 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa" returned: 0 in 0.573s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:57 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.info Nov 05 03:45:57 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:57 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f Nov 05 03:45:57 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:58 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.info" returned: 0 in 0.648s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:58 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-fdf49354-1b35-4106-be2e-8dad830af184 req-31f3b46a-16ba-4042-b04a-71f3b7350c88 tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:58 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.info Nov 05 03:45:58 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:58 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f" returned: 0 in 0.975s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:58 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f Nov 05 03:45:58 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:58 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.info" returned: 0 in 0.382s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.492s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:58 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-fdf49354-1b35-4106-be2e-8dad830af184 req-31f3b46a-16ba-4042-b04a-71f3b7350c88 tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.398s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-836c6ebf-e782-4abb-9150-8e5275de4a5f" returned: 0 in 0.369s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-fdf49354-1b35-4106-be2e-8dad830af184 req-31f3b46a-16ba-4042-b04a-71f3b7350c88 tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Lock "cinder-quobyte-836c6ebf-e782-4abb-9150-8e5275de4a5f" released by "delete_volume" :: held 1.462s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-fdf49354-1b35-4106-be2e-8dad830af184 req-31f3b46a-16ba-4042-b04a-71f3b7350c88 tempest-ServerActionsTestOtherA-1758953836 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '079d5e3e-3e4e-428b-9f2a-9e74d9929ed4', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:45:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0b727e82-a30f-4d61-8799-9ae42536eac5 tempest-GroupSnapshotsV319Test-771750642 None] group_snapshot 9df7b0af-da91-438d-9fb0-44e8779414f3: created successfully Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Created reservations ['6e2edb13-bfc2-40f3-b19b-5cdc95e91052', 'b0b16d84-d5c7-4555-9e07-742ba8d75d5b', 'd041396d-c0b6-4635-ae4b-26b56b430501', 'b5e65413-2a72-4bcf-9789-6c7011cc7514'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-fdf49354-1b35-4106-be2e-8dad830af184 req-31f3b46a-16ba-4042-b04a-71f3b7350c88 tempest-ServerActionsTestOtherA-1758953836 None] attachment_update completed successfully. Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:59 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:45:59 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:59 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.283s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Deleted volume successfully. Nov 05 03:45:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16f79818-0dd2-4bd5-b98f-49f1ce153ce5 tempest-VolumesMetadataTest-798207233 None] Lock "cinder-836c6ebf-e782-4abb-9150-8e5275de4a5f-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:00 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] group_snapshot 9df7b0af-da91-438d-9fb0-44e8779414f3: deleting Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] group_snapshot 9df7b0af-da91-438d-9fb0-44e8779414f3: deleting {{(pid=87111) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Acquiring lock "cinder-quobyte-60d29884-4cd9-449c-a76c-3ef7e76fddc4" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Lock "cinder-quobyte-60d29884-4cd9-449c-a76c-3ef7e76fddc4" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Acquiring lock "cinder-quobyte-55435b4d-8ce8-4f61-a516-b3237b2b34fa" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Lock "cinder-quobyte-55435b4d-8ce8-4f61-a516-b3237b2b34fa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Deleting offline snapshot 55435b4d-8ce8-4f61-a516-b3237b2b34fa of volume 60d29884-4cd9-449c-a76c-3ef7e76fddc4 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] snapshot_file for this snap is: volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2852c44-dc14-4372-ab33-95853aeb9e58]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:01 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa Nov 05 03:46:01 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:01 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa" returned: 0 in 0.883s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:46:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e49912f-dc8c-4944-80fa-d90c81200b9b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:02 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 Nov 05 03:46:02 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:02 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4" returned: 0 in 0.763s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:02 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa Nov 05 03:46:02 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:03 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa" returned: 0 in 0.733s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:03 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa Nov 05 03:46:03 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:03 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4.55435b4d-8ce8-4f61-a516-b3237b2b34fa" returned: 0 in 0.352s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Lock "cinder-quobyte-55435b4d-8ce8-4f61-a516-b3237b2b34fa" released by "_delete_snapshot" :: held 2.936s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Lock "cinder-quobyte-60d29884-4cd9-449c-a76c-3ef7e76fddc4" released by "delete_snapshot" :: held 2.976s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:03 devstack cinder-volume[87111]: WARNING cinder.quota [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-817078732 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-817078732, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:46:03 devstack cinder-volume[87111]: WARNING cinder.quota [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-817078732 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-817078732, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:46:03 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] Created reservations ['42e515bb-0d44-4acb-8bb0-053525959d8c', '1eeebe31-4011-4bd3-adb4-eda9e4a1c98b', '3b59aa94-d4ca-4ffd-b1cf-dbf512f39bb3', '47a1eeee-c73e-445e-8650-e137106040a3'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4834ea25-6e66-4ba1-954b-fc30f9d4b423 tempest-GroupSnapshotsV319Test-771750642 None] group_snapshot 9df7b0af-da91-438d-9fb0-44e8779414f3: deleted successfully Nov 05 03:46:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Acquiring lock "cinder-quobyte-60d29884-4cd9-449c-a76c-3ef7e76fddc4" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Lock "cinder-quobyte-60d29884-4cd9-449c-a76c-3ef7e76fddc4" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:04 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a36f3-a274-4e6f-ad8f-7e6a702a0e41]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:05 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 Nov 05 03:46:05 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:05 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4" returned: 0 in 0.440s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:05 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4 Nov 05 03:46:05 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:05 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-60d29884-4cd9-449c-a76c-3ef7e76fddc4" returned: 0 in 0.264s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Lock "cinder-quobyte-60d29884-4cd9-449c-a76c-3ef7e76fddc4" released by "delete_volume" :: held 0.803s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Created reservations ['5f7a8a1a-7c72-420b-85a3-0d33096215af'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:05 devstack cinder-volume[87111]: WARNING cinder.quota [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-817078732 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-817078732, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Created reservations ['12466c11-3e2c-494f-a6b0-a0345a7874f3', 'b1e0ef7d-4533-4ece-9475-8735cac0ff24', '6afb69fc-c01c-4169-bdd9-5687d472814e', 'a21b5d99-25f7-410e-862a-d04098a7386b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:05 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:46:05 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:06 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.354s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:06 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:06 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cd290ad8-eb97-4d00-9c54-da8c1f156340 tempest-GroupSnapshotsV319Test-771750642 None] Delete group completed successfully. Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Flow 'volume_create_manager' (8f93c566-fd64-4c56-bd55-770074266e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2851bcd-46ca-4641-9ef6-31fa5c779e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2851bcd-46ca-4641-9ef6-31fa5c779e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1019683865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9a79ed-12b6-428c-8036-0e2ea1707201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d440977c8d8465b893edf4b1e259409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:08Z,use_quota=True,user_id='4154e89d7f974360bfe63c6c885a501a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abad692-c7b9-4987-8016-352e15c125ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abad692-c7b9-4987-8016-352e15c125ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea796758-f928-49d4-b742-119366ec88e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea796758-f928-49d4-b742-119366ec88e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9a79ed-12b6-428c-8036-0e2ea1707201', 'volume_name': 'volume-5a9a79ed-12b6-428c-8036-0e2ea1707201', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b342b92-a872-4d4a-bbe6-0643515ab3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b342b92-a872-4d4a-bbe6-0643515ab3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b87edc-3c64-4b8b-8b72-c1d434bd2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:08 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Volume 5a9a79ed-12b6-428c-8036-0e2ea1707201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9a79ed-12b6-428c-8036-0e2ea1707201', 'volume_size': 1} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1019683865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9a79ed-12b6-428c-8036-0e2ea1707201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d440977c8d8465b893edf4b1e259409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:08Z,use_quota=True,user_id='4154e89d7f974360bfe63c6c885a501a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Creating volume 5a9a79ed-12b6-428c-8036-0e2ea1707201 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:08 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:08 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 1073741824 Nov 05 03:46:08 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:08 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 1073741824" returned: 0 in 0.499s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:08 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 Nov 05 03:46:08 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:09 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201" returned: 0 in 0.338s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b87edc-3c64-4b8b-8b72-c1d434bd2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9a79ed-12b6-428c-8036-0e2ea1707201', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec37038-6eb4-4974-8c3f-a8dc31eea6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:09 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Volume volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 (5a9a79ed-12b6-428c-8036-0e2ea1707201): created successfully Nov 05 03:46:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec37038-6eb4-4974-8c3f-a8dc31eea6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Flow 'volume_create_manager' (8f93c566-fd64-4c56-bd55-770074266e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:09 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ab428f8b-a520-45e4-9927-d814fea55941 tempest-VolumesTransfersV355Test-1166625629 None] Created volume successfully. Nov 05 03:46:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b4772852-66f7-4361-ba14-9fa015dbde43 tempest-VolumesTransfersV355Test-260099214 None] Transfer volume completed successfully. Nov 05 03:46:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Acquiring lock "cinder-5a9a79ed-12b6-428c-8036-0e2ea1707201-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Lock "cinder-5a9a79ed-12b6-428c-8036-0e2ea1707201-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Acquiring lock "cinder-quobyte-5a9a79ed-12b6-428c-8036-0e2ea1707201" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Lock "cinder-quobyte-5a9a79ed-12b6-428c-8036-0e2ea1707201" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fb07a9-242a-49a6-8392-65f664872be2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:13 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 Nov 05 03:46:13 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Flow 'volume_create_manager' (c33444c5-db26-4efa-8c18-adba1fef1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dbde9f-9611-437f-834d-343a56833144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dbde9f-9611-437f-834d-343a56833144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1413412549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84f56a4-23fa-4cf9-8408-4b477ec067a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9a803bcf2a4b889d33e7caf3735358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:13Z,use_quota=True,user_id='f0642a9277474f4da92cd0dae21b3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a96097-3245-4e00-9687-698e12f98f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a96097-3245-4e00-9687-698e12f98f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18d20fe-9828-457b-97e8-b3ac4f8f380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18d20fe-9828-457b-97e8-b3ac4f8f380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84f56a4-23fa-4cf9-8408-4b477ec067a1', 'volume_name': 'volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa296a3-7eba-4f5a-a28d-85b2933f11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa296a3-7eba-4f5a-a28d-85b2933f11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03354487-c310-4b58-987e-cc08d6c56e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:13 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Volume d84f56a4-23fa-4cf9-8408-4b477ec067a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1', 'volume_size': 1} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1413412549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84f56a4-23fa-4cf9-8408-4b477ec067a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9a803bcf2a4b889d33e7caf3735358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:13Z,use_quota=True,user_id='f0642a9277474f4da92cd0dae21b3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Creating volume d84f56a4-23fa-4cf9-8408-4b477ec067a1 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:13 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:13 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 1073741824 Nov 05 03:46:13 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:13 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201" returned: 0 in 0.447s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:13 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201 Nov 05 03:46:13 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:13 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5a9a79ed-12b6-428c-8036-0e2ea1707201" returned: 0 in 0.384s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Lock "cinder-quobyte-5a9a79ed-12b6-428c-8036-0e2ea1707201" released by "delete_volume" :: held 0.896s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:13 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 1073741824" returned: 0 in 0.554s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:13 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 Nov 05 03:46:13 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:13 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Created reservations ['cd03ff47-2bff-41bf-b84f-dbd416b22426', 'c62f42cb-380b-4546-8d0b-fe1765de9671', '16140ee3-479b-4867-b3ee-045233fc3e4b', '53558cbb-afe2-4f4e-b50b-d3d936255c98'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:14 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:46:14 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-04ff5d09-d62d-407e-8304-8be3782ad3b7 tempest-GroupsV320Test-2134226826 None] Group tempest-GroupsV320Test-Group-1565347272: creating Nov 05 03:46:14 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1" returned: 0 in 0.370s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-04ff5d09-d62d-407e-8304-8be3782ad3b7 tempest-GroupsV320Test-2134226826 None] Group tempest-GroupsV320Test-Group-1565347272: created successfully Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03354487-c310-4b58-987e-cc08d6c56e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04760f65-cd5d-4a07-91ca-31fa3c160563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-04ff5d09-d62d-407e-8304-8be3782ad3b7 tempest-GroupsV320Test-2134226826 None] Create group completed successfully. Nov 05 03:46:14 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Volume volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 (d84f56a4-23fa-4cf9-8408-4b477ec067a1): created successfully Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04760f65-cd5d-4a07-91ca-31fa3c160563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Flow 'volume_create_manager' (c33444c5-db26-4efa-8c18-adba1fef1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-20018872-81a1-4f83-b7f3-1e416d7faf98 tempest-AttachVolumeTestJSON-636569192 None] Created volume successfully. Nov 05 03:46:14 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.296s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Deleted volume successfully. Nov 05 03:46:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e933241d-b715-456f-b50c-3f2dfa64f65a tempest-VolumesTransfersV355Test-584400384 None] Lock "cinder-5a9a79ed-12b6-428c-8036-0e2ea1707201-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:15 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:46:15 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:15 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.561s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Flow 'volume_create_manager' (111e05a5-29fe-473a-861a-5a01681b2291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d55f838-d428-400f-b667-d5004cb855ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 8 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d55f838-d428-400f-b667-d5004cb855ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-364892264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4244063c-6966-48a5-bfdf-ad0ccf68fdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d440977c8d8465b893edf4b1e259409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:16Z,use_quota=True,user_id='4154e89d7f974360bfe63c6c885a501a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c0665c-1457-41ec-9ce3-502d51afd465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c0665c-1457-41ec-9ce3-502d51afd465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3476ab09-b0e4-46fd-af3b-2953a32e102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3476ab09-b0e4-46fd-af3b-2953a32e102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4244063c-6966-48a5-bfdf-ad0ccf68fdf8', 'volume_name': 'volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdca0a55-7976-4234-a753-2dbd8b690d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdca0a55-7976-4234-a753-2dbd8b690d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec039ed7-22b4-495b-a416-262d5b8b18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:15 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Volume 4244063c-6966-48a5-bfdf-ad0ccf68fdf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8', 'volume_size': 1} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-364892264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4244063c-6966-48a5-bfdf-ad0ccf68fdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d440977c8d8465b893edf4b1e259409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:16Z,use_quota=True,user_id='4154e89d7f974360bfe63c6c885a501a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Creating volume 4244063c-6966-48a5-bfdf-ad0ccf68fdf8 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:15 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:46:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:16 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 1073741824 Nov 05 03:46:16 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-87aeb290-cd5f-4c51-b959-a4bf1c57388f req-2cfd0e3a-34a5-4fd4-b329-42c43d01d768 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Created reservations ['2fd75090-e5af-4f56-93fb-e4fb40822efa'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:16 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:46:16 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:16 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 1073741824" returned: 0 in 0.660s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:16 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 Nov 05 03:46:16 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:16 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.315s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:16 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-09ea32f1-6bd1-42de-898d-b30b3a18930d tempest-GroupsV320Test-2134226826 None] Delete group completed successfully. Nov 05 03:46:16 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-87aeb290-cd5f-4c51-b959-a4bf1c57388f req-2cfd0e3a-34a5-4fd4-b329-42c43d01d768 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.605s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec039ed7-22b4-495b-a416-262d5b8b18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf8b4a1-3a4f-48ab-95e0-bf7cffa69dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-87aeb290-cd5f-4c51-b959-a4bf1c57388f req-2cfd0e3a-34a5-4fd4-b329-42c43d01d768 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:17 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Volume volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 (4244063c-6966-48a5-bfdf-ad0ccf68fdf8): created successfully Nov 05 03:46:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf8b4a1-3a4f-48ab-95e0-bf7cffa69dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Flow 'volume_create_manager' (111e05a5-29fe-473a-861a-5a01681b2291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5cb311cb-83c7-4f4d-8307-6d5742260b7b tempest-VolumesTransfersV355Test-1166625629 None] Created volume successfully. Nov 05 03:46:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-87aeb290-cd5f-4c51-b959-a4bf1c57388f req-2cfd0e3a-34a5-4fd4-b329-42c43d01d768 tempest-AttachVolumeTestJSON-636569192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db0361d3-b7f2-4e5b-a014-e844132c01f5', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:46:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-87aeb290-cd5f-4c51-b959-a4bf1c57388f req-2cfd0e3a-34a5-4fd4-b329-42c43d01d768 tempest-AttachVolumeTestJSON-636569192 None] attachment_update completed successfully. Nov 05 03:46:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Acquiring lock "cinder-4244063c-6966-48a5-bfdf-ad0ccf68fdf8-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Lock "cinder-4244063c-6966-48a5-bfdf-ad0ccf68fdf8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Acquiring lock "cinder-quobyte-4244063c-6966-48a5-bfdf-ad0ccf68fdf8" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Lock "cinder-quobyte-4244063c-6966-48a5-bfdf-ad0ccf68fdf8" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c41502-92a5-423f-b8be-c1bcbe65b0d6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:18 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 Nov 05 03:46:18 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:18 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8" returned: 0 in 0.436s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:18 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8 Nov 05 03:46:18 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:19 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4244063c-6966-48a5-bfdf-ad0ccf68fdf8" returned: 0 in 0.289s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Lock "cinder-quobyte-4244063c-6966-48a5-bfdf-ad0ccf68fdf8" released by "delete_volume" :: held 0.786s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Created reservations ['d0487084-9c1a-4e0c-9fea-1ef2a626f4df', 'b3a5ec68-06a8-4581-b2b7-5c474a76a695', '1958864e-e465-426d-9441-8949b3b23b92', '5da180fa-9dae-449f-ac9e-13e4815417a0'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:19 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:46:19 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:19 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.284s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:19 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Deleted volume successfully. Nov 05 03:46:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f767c8b1-875f-401e-9d03-b2a024322ed7 tempest-VolumesTransfersV355Test-584400384 None] Lock "cinder-4244063c-6966-48a5-bfdf-ad0ccf68fdf8-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:DELETE=13,cinder:UPDATE=132,cinder:SELECT=124,cinder:INSERT=26 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=140,cinder:SELECT=134,cinder:INSERT=34,cinder:DELETE=7 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Flow 'volume_create_manager' (c798561f-a561-4e06-a185-9076e11b9e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbd8146-3738-400a-a844-52a13fa23c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbd8146-3738-400a-a844-52a13fa23c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1216141207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7596405-3a40-46ec-8dd5-0b6642117877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='613dc7d2b2dd4f96802612596ab230af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:30Z,use_quota=True,user_id='bf37767f916d438bb8ea19d4cb177142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8910235c-ceb8-4fca-ab61-77d8fb2a2053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8910235c-ceb8-4fca-ab61-77d8fb2a2053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534101d9-9aa4-4773-a638-4ff2ebda9646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534101d9-9aa4-4773-a638-4ff2ebda9646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7596405-3a40-46ec-8dd5-0b6642117877', 'volume_name': 'volume-a7596405-3a40-46ec-8dd5-0b6642117877', 'volume_size': 2}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42651130-bcc3-4044-b566-b1ca20914ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42651130-bcc3-4044-b566-b1ca20914ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f6e793-d695-4d36-b95b-45bdc19557d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Volume a7596405-3a40-46ec-8dd5-0b6642117877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7596405-3a40-46ec-8dd5-0b6642117877', 'volume_size': 2} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1216141207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7596405-3a40-46ec-8dd5-0b6642117877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='613dc7d2b2dd4f96802612596ab230af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:30Z,use_quota=True,user_id='bf37767f916d438bb8ea19d4cb177142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Creating volume a7596405-3a40-46ec-8dd5-0b6642117877 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:29 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:46:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 2147483648 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:30 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 2147483648 Nov 05 03:46:30 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:30 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 2147483648" returned: 0 in 0.685s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:30 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 Nov 05 03:46:30 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:31 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877" returned: 0 in 0.284s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f6e793-d695-4d36-b95b-45bdc19557d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7596405-3a40-46ec-8dd5-0b6642117877', 'volume_size': 2}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e19029-fd4b-498d-9b7a-b2d2b8407e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:31 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Volume volume-a7596405-3a40-46ec-8dd5-0b6642117877 (a7596405-3a40-46ec-8dd5-0b6642117877): created successfully Nov 05 03:46:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e19029-fd4b-498d-9b7a-b2d2b8407e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Flow 'volume_create_manager' (c798561f-a561-4e06-a185-9076e11b9e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7b7f06b6-743b-453c-86ab-9efe23db14f0 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Created volume successfully. Nov 05 03:46:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Creating offline snapshot 1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c of volume a7596405-3a40-46ec-8dd5-0b6642117877 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:46:32 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4615a15-0c06-4d92-a8af-6fc3f3ccf577]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:32 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 Nov 05 03:46:32 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:32 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877" returned: 0 in 0.417s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c 2G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:32 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c 2G Nov 05 03:46:32 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:33 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c 2G" returned: 0 in 0.504s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7596405-3a40-46ec-8dd5-0b6642117877 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:33 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7596405-3a40-46ec-8dd5-0b6642117877 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c Nov 05 03:46:33 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:33 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7596405-3a40-46ec-8dd5-0b6642117877 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c" returned: 0 in 0.323s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:33 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c is being set with open permissions: ugo+rw Nov 05 03:46:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:33 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c Nov 05 03:46:33 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:33 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c" returned: 0 in 0.280s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:33 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.info Nov 05 03:46:33 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:34 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.info" returned: 0 in 0.333s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:34 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.info is being set with open permissions: ugo+rw Nov 05 03:46:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:34 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.info Nov 05 03:46:34 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:34 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.info" returned: 0 in 0.302s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:34 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cf8dffd9-d5a1-47db-8150-a787ed34daed tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Create snapshot completed successfully Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "cinder-1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "cinder-quobyte-a7596405-3a40-46ec-8dd5-0b6642117877" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-quobyte-a7596405-3a40-46ec-8dd5-0b6642117877" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "cinder-quobyte-1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-quobyte-1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Deleting offline snapshot 1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c of volume a7596405-3a40-46ec-8dd5-0b6642117877 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] snapshot_file for this snap is: volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4579df9-4313-4f25-a935-c69e6c45c2a3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:35 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c Nov 05 03:46:35 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:36 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c" returned: 0 in 0.471s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7596405-3a40-46ec-8dd5-0b6642117877(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:46:36 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ca6e3-3e45-4396-9a21-c6c9110de786]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:36 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 Nov 05 03:46:36 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:36 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877" returned: 0 in 0.442s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:36 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c Nov 05 03:46:36 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:37 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c" returned: 0 in 0.467s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:37 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c Nov 05 03:46:37 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:37 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877.1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c" returned: 0 in 0.277s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-quobyte-1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c" released by "_delete_snapshot" :: held 1.805s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-quobyte-a7596405-3a40-46ec-8dd5-0b6642117877" released by "delete_snapshot" :: held 1.840s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:37 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Created reservations ['315fbf8a-f41c-4243-be59-9a21af8d92b8', '10fab388-26a4-4919-bc42-e30f8ebfbe0f', 'b0ee0ec4-4e24-47f0-b39e-99f7165bca59', 'f5dee31c-0851-49bf-b700-1c4a111d02a2'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Delete snapshot completed successfully. Nov 05 03:46:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-054374ce-7991-4038-a707-deb32c386677 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-1263e79a-e921-4a3a-8d4f-c3b5e5cd7d1c-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "cinder-a7596405-3a40-46ec-8dd5-0b6642117877-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-a7596405-3a40-46ec-8dd5-0b6642117877-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "cinder-quobyte-a7596405-3a40-46ec-8dd5-0b6642117877" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-quobyte-a7596405-3a40-46ec-8dd5-0b6642117877" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e277e4cd-b443-4b76-bb11-2169e757d27f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:38 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 Nov 05 03:46:38 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:38 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877" returned: 0 in 0.406s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:38 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877 Nov 05 03:46:38 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:38 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a7596405-3a40-46ec-8dd5-0b6642117877" returned: 0 in 0.274s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-quobyte-a7596405-3a40-46ec-8dd5-0b6642117877" released by "delete_volume" :: held 0.767s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Created reservations ['f001ffe6-ef56-4b4d-a790-683580a53e9c', '67366925-69b3-4e55-aaea-0983edd1cee5', '24661f31-85b8-401d-ba2d-ea6f4dcec7f6', 'f8c38d25-c58b-42b5-9941-cdabafb814e8'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:39 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:46:39 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:39 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.258s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Deleted volume successfully. Nov 05 03:46:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-80196840-2f88-47f1-bf40-0773496781f3 tempest-VolumesSnapshotNegativeTestJSON-637801092 None] Lock "cinder-a7596405-3a40-46ec-8dd5-0b6642117877-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Flow 'volume_create_manager' (7e8971c2-5bfa-495f-8008-28f806d66ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a2c1c-b5f1-4fff-bde6-54401e722f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a2c1c-b5f1-4fff-bde6-54401e722f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1668199457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b42d3a-cbe3-4c17-af73-d4f02eb4014a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e94989576b44a1b4d4a5de1766f5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:42Z,use_quota=True,user_id='0cb21cc949dd41e19f363d76ab7565bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc45be85-943b-4aa6-87e6-c7e3e0eeb6b7),volume_type_id=bc45be85-943b-4aa6-87e6-c7e3e0eeb6b7)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293f0e13-6938-4105-9949-4c16f734e2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293f0e13-6938-4105-9949-4c16f734e2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3249751c-5b40-4641-9c10-6077c35eb99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3249751c-5b40-4641-9c10-6077c35eb99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b42d3a-cbe3-4c17-af73-d4f02eb4014a', 'volume_name': 'volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bbc424-2180-45bb-baa7-9719af86a889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bbc424-2180-45bb-baa7-9719af86a889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c8c1a2-93fc-4e57-bdec-ea85305bdf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Volume 59b42d3a-cbe3-4c17-af73-d4f02eb4014a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a', 'volume_size': 1} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1668199457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b42d3a-cbe3-4c17-af73-d4f02eb4014a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e94989576b44a1b4d4a5de1766f5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:42Z,use_quota=True,user_id='0cb21cc949dd41e19f363d76ab7565bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc45be85-943b-4aa6-87e6-c7e3e0eeb6b7),volume_type_id=bc45be85-943b-4aa6-87e6-c7e3e0eeb6b7)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Creating volume 59b42d3a-cbe3-4c17-af73-d4f02eb4014a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:42 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:42 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a 1073741824 Nov 05 03:46:42 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:42 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a 1073741824" returned: 0 in 0.597s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:43 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a Nov 05 03:46:43 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:43 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-1c172046-33f1-4cd3-b151-f7a39ed4172e req-557968c0-ddd2-4a51-b36d-fcf9bc01efed tempest-ServerActionsTestOtherA-1758953836 None] Terminate volume connection completed successfully. Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-1c172046-33f1-4cd3-b151-f7a39ed4172e req-557968c0-ddd2-4a51-b36d-fcf9bc01efed tempest-ServerActionsTestOtherA-1758953836 None] Deleting attachment 079d5e3e-3e4e-428b-9f2a-9e74d9929ed4. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:46:43 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a" returned: 0 in 0.312s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c8c1a2-93fc-4e57-bdec-ea85305bdf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377abf85-dd6e-40ef-b8e2-ac608bafde88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:43 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Volume volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a (59b42d3a-cbe3-4c17-af73-d4f02eb4014a): created successfully Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377abf85-dd6e-40ef-b8e2-ac608bafde88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Flow 'volume_create_manager' (7e8971c2-5bfa-495f-8008-28f806d66ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:43 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-def8d0ac-a391-4354-9e76-b0a50e768e31 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Created volume successfully. Nov 05 03:46:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:45 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:46:45 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:45 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.342s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:45 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:45 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5d2799b0-979b-43d5-994e-6d382db50a47 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Retype volume completed successfully. Nov 05 03:46:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Acquiring lock "cinder-59b42d3a-cbe3-4c17-af73-d4f02eb4014a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "cinder-59b42d3a-cbe3-4c17-af73-d4f02eb4014a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Acquiring lock "cinder-quobyte-59b42d3a-cbe3-4c17-af73-d4f02eb4014a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "cinder-quobyte-59b42d3a-cbe3-4c17-af73-d4f02eb4014a" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:46 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe47405-9155-47d6-9ae7-ee0673a1c852]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:46 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a Nov 05 03:46:46 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:47 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a" returned: 0 in 0.536s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:47 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a Nov 05 03:46:47 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:47 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-59b42d3a-cbe3-4c17-af73-d4f02eb4014a" returned: 0 in 0.344s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "cinder-quobyte-59b42d3a-cbe3-4c17-af73-d4f02eb4014a" released by "delete_volume" :: held 0.934s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:47 devstack cinder-volume[87111]: WARNING cinder.quota [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:46:47 devstack cinder-volume[87111]: WARNING cinder.quota [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Created reservations ['91a31096-e4a3-41f9-a96c-5ac042480dbe', '09a8b463-03fe-471e-8958-a18fbc9607ab', '4906d0e4-35ab-4977-a5a7-a9483f35f801', 'e4a51461-b7f0-42d7-b7dc-11ce0eaf5293'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:47 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:46:47 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:48 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.386s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:48 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Deleted volume successfully. Nov 05 03:46:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dbe5220-5066-4bf4-a749-e045baf1e609 tempest-VolumeRetypeWithoutMigrationTest-2038508612 None] Lock "cinder-59b42d3a-cbe3-4c17-af73-d4f02eb4014a-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-3929d0d5-4cc9-4691-9382-f4ba26e02a2b req-ca9b428b-aaa5-43d3-8e7d-97acf3377296 tempest-AttachVolumeTestJSON-636569192 None] Terminate volume connection completed successfully. Nov 05 03:46:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-3929d0d5-4cc9-4691-9382-f4ba26e02a2b req-ca9b428b-aaa5-43d3-8e7d-97acf3377296 tempest-AttachVolumeTestJSON-636569192 None] Deleting attachment db0361d3-b7f2-4e5b-a014-e844132c01f5. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:46:51 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Flow 'volume_create_manager' (4cf97916-ec5f-49ab-81c4-815cd9c89f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c06396-860c-44d4-93d7-725ee0bbcc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c06396-860c-44d4-93d7-725ee0bbcc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-775543902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8dd3604-b652-4dc5-bd32-68088ab6e990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1ca37e69514ade90e3691f2c130666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:52Z,use_quota=True,user_id='91075d4d52cc43a896d38d12ce9e06b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf8e288-b7d8-4089-9d1a-eb6c55b3824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf8e288-b7d8-4089-9d1a-eb6c55b3824f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaf9150-2b52-4a24-8c36-31c025e9c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:51 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:46:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaf9150-2b52-4a24-8c36-31c025e9c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8dd3604-b652-4dc5-bd32-68088ab6e990', 'volume_name': 'volume-b8dd3604-b652-4dc5-bd32-68088ab6e990', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f833e16c-b558-415a-a555-c5d70fc5e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f833e16c-b558-415a-a555-c5d70fc5e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfec061b-9d7a-4cf8-9d67-c2d41c3b02f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Volume b8dd3604-b652-4dc5-bd32-68088ab6e990: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8dd3604-b652-4dc5-bd32-68088ab6e990', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:46:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Trying to clone b8dd3604-b652-4dc5-bd32-68088ab6e990 from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:46:53 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:46:53 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:46:53 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70795b3-1224-4bd7-b680-325d82d3f9dc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:53 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD Nov 05 03:46:53 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:53 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:53 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 is fetched for user 91075d4d52cc43a896d38d12ce9e06b4. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:46:53 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4a5bd-66bf-4655-a8dc-c9d9b72c9b01]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:54 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD Nov 05 03:46:54 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:54 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-775543902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8dd3604-b652-4dc5-bd32-68088ab6e990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1ca37e69514ade90e3691f2c130666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:52Z,use_quota=True,user_id='91075d4d52cc43a896d38d12ce9e06b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Creating volume b8dd3604-b652-4dc5-bd32-68088ab6e990 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:54 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:46:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:54 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 1073741824 Nov 05 03:46:54 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:55 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 1073741824" returned: 0 in 0.776s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:55 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 Nov 05 03:46:55 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:55 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990" returned: 0 in 0.485s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:55 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Attempting download of f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume b8dd3604-b652-4dc5-bd32-68088ab6e990. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:46:55 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffcaf67-39fb-44e7-bc07-ee5733e05752]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_3jii9e4u {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:55 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_3jii9e4u Nov 05 03:46:55 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:56 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_3jii9e4u" returned: 0 in 0.589s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_3jii9e4u {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:56 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_3jii9e4u Nov 05 03:46:56 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:57 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_3jii9e4u" returned: 1 in 0.691s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_3jii9e4u' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:46:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb825b6a-ef3d-4f40-91c7-57b3df187e53]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:57 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD Nov 05 03:46:57 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:57 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:57 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] f813bdfc-9ad7-4949-b238-678b8d2b8f65 was qcow2, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:46:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:57 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 Nov 05 03:46:57 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Flow 'volume_create_manager' (9665b27c-88a5-4e86-98eb-fcd0c483d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ee51d2-2a77-4e14-ac16-f82fde1bad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ee51d2-2a77-4e14-ac16-f82fde1bad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-130482429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5f7f3c-47fc-41f0-ac44-324c8ac853c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc339e9d3bf45568e5b65eb9a151e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:59Z,use_quota=True,user_id='44cecfbd27e648979199018435779468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591d4835-580a-49de-925e-af1680e23c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591d4835-580a-49de-925e-af1680e23c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d989b04-be0f-4d4e-a9c5-5dbd0b2ea0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d989b04-be0f-4d4e-a9c5-5dbd0b2ea0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5f7f3c-47fc-41f0-ac44-324c8ac853c2', 'volume_name': 'volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01f5012-620a-47c2-94e8-f4241036a444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01f5012-620a-47c2-94e8-f4241036a444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803176ea-d335-41e2-b623-8bdd8edaf293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Volume fe5f7f3c-47fc-41f0-ac44-324c8ac853c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2', 'volume_size': 1} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-130482429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5f7f3c-47fc-41f0-ac44-324c8ac853c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc339e9d3bf45568e5b65eb9a151e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:59Z,use_quota=True,user_id='44cecfbd27e648979199018435779468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Creating volume fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:59 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:46:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:59 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 1073741824 Nov 05 03:46:59 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:00 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 1073741824" returned: 0 in 0.881s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:00 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 Nov 05 03:47:00 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:00 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2" returned: 0 in 0.382s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803176ea-d335-41e2-b623-8bdd8edaf293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0565888-1556-4fc8-9c99-1e80e532f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:00 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Volume volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 (fe5f7f3c-47fc-41f0-ac44-324c8ac853c2): created successfully Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0565888-1556-4fc8-9c99-1e80e532f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Flow 'volume_create_manager' (9665b27c-88a5-4e86-98eb-fcd0c483d23b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:00 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fdcc4867-b776-424d-814c-a127f036ebce tempest-VolumesServicesTestJSON-1702292163 None] Created volume successfully. Nov 05 03:47:01 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990" returned: 0 in 3.536s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_kpftgohodevstack@QuobyteHD, size 112.00 MB, duration 3.54 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:47:01 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Converted 112.00 MB image at 31.65 MB/s Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:01 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 1G Nov 05 03:47:01 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Acquiring lock "cinder-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Lock "cinder-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Acquiring lock "cinder-quobyte-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Lock "cinder-quobyte-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd41d482-7439-4370-900a-ecf78fbd35e3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:01 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 Nov 05 03:47:01 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:01 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 1G" returned: 0 in 0.455s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Downloaded image f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume b8dd3604-b652-4dc5-bd32-68088ab6e990 successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 for user 91075d4d52cc43a896d38d12ce9e06b4 is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Marking volume b8dd3604-b652-4dc5-bd32-68088ab6e990 as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Copying metadata from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 to b8dd3604-b652-4dc5-bd32-68088ab6e990. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Creating volume glance metadata for volume b8dd3604-b652-4dc5-bd32-68088ab6e990 backed by image f813bdfc-9ad7-4949-b238-678b8d2b8f65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfec061b-9d7a-4cf8-9d67-c2d41c3b02f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8dd3604-b652-4dc5-bd32-68088ab6e990', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dd78a0-8f75-4e44-801e-88244b418320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:01 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Volume volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 (b8dd3604-b652-4dc5-bd32-68088ab6e990): created successfully Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dd78a0-8f75-4e44-801e-88244b418320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Flow 'volume_create_manager' (4cf97916-ec5f-49ab-81c4-815cd9c89f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-926dd374-d62b-41f4-a892-13105094212e tempest-ServerActionsTestOtherA-1758953836 None] Created volume successfully. Nov 05 03:47:02 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2" returned: 0 in 0.538s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:02 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2 Nov 05 03:47:02 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:02 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2" returned: 0 in 0.357s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Lock "cinder-quobyte-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2" released by "delete_volume" :: held 0.963s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Created reservations ['8fdb56b2-c014-4b85-9c76-465fcd7f7483', 'f0c5abec-6dee-409b-8e6c-54a6b623581e', 'b6a958bf-c0ea-4e21-b8dd-eb510f8fa925', '17b0a227-b125-4d42-985f-9c509429f147'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:02 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:47:02 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:02 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.305s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:02 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:03 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Deleted volume successfully. Nov 05 03:47:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e386f1e4-056f-4451-b514-91d32e512c2e tempest-VolumesServicesTestJSON-1702292163 None] Lock "cinder-fe5f7f3c-47fc-41f0-ac44-324c8ac853c2-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-7648b6b4-4a24-481a-8abb-733137fcea5a req-56a8a806-197d-42c2-b097-109c613dfdb2 tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-7648b6b4-4a24-481a-8abb-733137fcea5a req-56a8a806-197d-42c2-b097-109c613dfdb2 tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-7648b6b4-4a24-481a-8abb-733137fcea5a req-56a8a806-197d-42c2-b097-109c613dfdb2 tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-7648b6b4-4a24-481a-8abb-733137fcea5a req-56a8a806-197d-42c2-b097-109c613dfdb2 tempest-ServerActionsTestOtherA-1758953836 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-b8dd3604-b652-4dc5-bd32-68088ab6e990', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e3531c9-4b78-48ba-ae7d-c5f2797227b6', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:47:08 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-7648b6b4-4a24-481a-8abb-733137fcea5a req-56a8a806-197d-42c2-b097-109c613dfdb2 tempest-ServerActionsTestOtherA-1758953836 None] attachment_update completed successfully. Nov 05 03:47:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Flow 'volume_create_manager' (fdbf7ca7-bdfe-44d5-aae8-8e41c8c7a045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16380522-3814-4061-9a25-a8a3e44a1c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16380522-3814-4061-9a25-a8a3e44a1c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-55767455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4a5efa-df68-4e28-814c-b3f838bb0afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfe52141b8348d1bd9afba443480ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:14Z,use_quota=True,user_id='6aed954d68de419d87e1173e0eb563fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b713858-576c-41bc-a14e-e7a83045f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b713858-576c-41bc-a14e-e7a83045f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdc2b4d-18b1-4143-8c2a-33e46ede6b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdc2b4d-18b1-4143-8c2a-33e46ede6b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4a5efa-df68-4e28-814c-b3f838bb0afc', 'volume_name': 'volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2f8ab5-c1fa-45a3-97f8-da5f97e5aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2f8ab5-c1fa-45a3-97f8-da5f97e5aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e85208-66dc-45f3-b411-67bb86ec08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:14 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Volume 6c4a5efa-df68-4e28-814c-b3f838bb0afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc', 'volume_size': 1} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-55767455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4a5efa-df68-4e28-814c-b3f838bb0afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfe52141b8348d1bd9afba443480ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:14Z,use_quota=True,user_id='6aed954d68de419d87e1173e0eb563fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Creating volume 6c4a5efa-df68-4e28-814c-b3f838bb0afc {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:14 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:14 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc 1073741824 Nov 05 03:47:14 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:14 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc 1073741824" returned: 0 in 0.627s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:14 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc Nov 05 03:47:14 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:15 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc" returned: 0 in 0.379s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e85208-66dc-45f3-b411-67bb86ec08f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2346dd9d-2e6a-4485-8c08-404d3c49e719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:15 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Volume volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc (6c4a5efa-df68-4e28-814c-b3f838bb0afc): created successfully Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2346dd9d-2e6a-4485-8c08-404d3c49e719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Flow 'volume_create_manager' (fdbf7ca7-bdfe-44d5-aae8-8e41c8c7a045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-1ba5b82a-ca58-47bb-8427-b9e5c9621dec tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Created volume successfully. Nov 05 03:47:15 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:47:15 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:15 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.296s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:47:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:47:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Creating offline snapshot 231184c7-e895-4b07-a74f-f9c50732faf3 of volume 6c4a5efa-df68-4e28-814c-b3f838bb0afc {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:47:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f60f1-2ce0-430c-a7a1-3b91bc43ccef]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:16 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc Nov 05 03:47:16 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:17 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc" returned: 0 in 0.526s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:17 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 1G Nov 05 03:47:17 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:17 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 1G" returned: 0 in 0.728s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:17 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 Nov 05 03:47:17 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:18 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3" returned: 0 in 0.376s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:18 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 is being set with open permissions: ugo+rw Nov 05 03:47:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:18 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 Nov 05 03:47:18 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:18 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3" returned: 0 in 0.433s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:18 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.info Nov 05 03:47:18 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:19 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.info" returned: 0 in 0.457s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:19 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.info is being set with open permissions: ugo+rw Nov 05 03:47:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:19 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.info Nov 05 03:47:19 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:19 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.info" returned: 0 in 0.571s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.299s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-85dc38d6-bdab-42a0-89fb-c2e57a0eb833 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Create snapshot completed successfully Nov 05 03:47:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "cinder-231184c7-e895-4b07-a74f-f9c50732faf3-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-231184c7-e895-4b07-a74f-f9c50732faf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "cinder-quobyte-6c4a5efa-df68-4e28-814c-b3f838bb0afc" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-quobyte-6c4a5efa-df68-4e28-814c-b3f838bb0afc" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "cinder-quobyte-231184c7-e895-4b07-a74f-f9c50732faf3" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-quobyte-231184c7-e895-4b07-a74f-f9c50732faf3" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Deleting offline snapshot 231184c7-e895-4b07-a74f-f9c50732faf3 of volume 6c4a5efa-df68-4e28-814c-b3f838bb0afc {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:47:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] snapshot_file for this snap is: volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:47:22 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c7107-a77e-4108-8fb4-f7888d0186e3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:22 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 Nov 05 03:47:22 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:22 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3" returned: 0 in 0.744s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:47:23 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb124e4f-3c96-4d99-b289-01de94b9feb1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:23 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc Nov 05 03:47:23 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:24 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc" returned: 0 in 0.989s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:24 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 Nov 05 03:47:24 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:24 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3" returned: 0 in 0.896s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:24 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3 Nov 05 03:47:24 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:25 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc.231184c7-e895-4b07-a74f-f9c50732faf3" returned: 0 in 0.655s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-quobyte-231184c7-e895-4b07-a74f-f9c50732faf3" released by "_delete_snapshot" :: held 3.665s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-quobyte-6c4a5efa-df68-4e28-814c-b3f838bb0afc" released by "delete_snapshot" :: held 3.752s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:25 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Created reservations ['07ebf172-4e32-4327-9825-8b7f998875aa', 'ac8d6ff8-e1b1-4277-93b7-7a89a0fc3632', '7f0b292b-0fe8-420f-a24a-887f900e0aec', '0b508f2e-6c63-4f41-b0b4-3f79df6115ed'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:26 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Delete snapshot completed successfully. Nov 05 03:47:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8f31899d-6058-44a2-8c15-1987826c23a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-231184c7-e895-4b07-a74f-f9c50732faf3-delete_snapshot" released by "delete_snapshot" :: held 4.229s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "cinder-6c4a5efa-df68-4e28-814c-b3f838bb0afc-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-6c4a5efa-df68-4e28-814c-b3f838bb0afc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "cinder-quobyte-6c4a5efa-df68-4e28-814c-b3f838bb0afc" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-quobyte-6c4a5efa-df68-4e28-814c-b3f838bb0afc" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:26 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[75290557-bc2c-40b9-a53f-00a469c100f8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:27 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc Nov 05 03:47:27 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:27 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc" returned: 0 in 0.691s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:27 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc Nov 05 03:47:27 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:28 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6c4a5efa-df68-4e28-814c-b3f838bb0afc" returned: 0 in 0.484s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-quobyte-6c4a5efa-df68-4e28-814c-b3f838bb0afc" released by "delete_volume" :: held 1.330s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Created reservations ['85a9d0b5-bac5-45cf-90f5-9889d17fae74', '843a40af-c8f9-44c1-ad76-46f6e663a4b7', '2635a6a4-337b-48cc-937e-97f00a0e2aaa', '47bdda2c-f7b1-4769-9fa1-3ee1f0ecdc8c'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:28 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:47:28 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:28 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.360s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Deleted volume successfully. Nov 05 03:47:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21a8cfbf-e57a-4ae6-bdea-89aff4b77f0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1454690863 None] Lock "cinder-6c4a5efa-df68-4e28-814c-b3f838bb0afc-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:30 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=70,cinder:SELECT=76,cinder:DELETE=4,cinder:INSERT=23 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:47:30 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=77,cinder:UPDATE=68,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:47:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-ff6f3ed3-6875-44da-bf33-755bf3168f25 req-e18d38f1-01ab-4b85-bbee-18da55c8ff44 tempest-ServerActionsTestOtherA-1758953836 None] Terminate volume connection completed successfully. Nov 05 03:47:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-ff6f3ed3-6875-44da-bf33-755bf3168f25 req-e18d38f1-01ab-4b85-bbee-18da55c8ff44 tempest-ServerActionsTestOtherA-1758953836 None] Deleting attachment 0e3531c9-4b78-48ba-ae7d-c5f2797227b6. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:47:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ff6f3ed3-6875-44da-bf33-755bf3168f25 req-d7bf9d41-f578-4426-8ffb-dfc683ed727d tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ff6f3ed3-6875-44da-bf33-755bf3168f25 req-d7bf9d41-f578-4426-8ffb-dfc683ed727d tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ff6f3ed3-6875-44da-bf33-755bf3168f25 req-d7bf9d41-f578-4426-8ffb-dfc683ed727d tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-ff6f3ed3-6875-44da-bf33-755bf3168f25 req-d7bf9d41-f578-4426-8ffb-dfc683ed727d tempest-ServerActionsTestOtherA-1758953836 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-b8dd3604-b652-4dc5-bd32-68088ab6e990', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17021e94-b725-4358-b8ff-8aaa8e60cf6a', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:47:36 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-ff6f3ed3-6875-44da-bf33-755bf3168f25 req-d7bf9d41-f578-4426-8ffb-dfc683ed727d tempest-ServerActionsTestOtherA-1758953836 None] attachment_update completed successfully. Nov 05 03:47:43 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Flow 'volume_create_manager' (ccb8dddb-d37c-4664-b9f7-d7af900dc1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5325b90-b804-4f2a-aa4b-c08550f40a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5325b90-b804-4f2a-aa4b-c08550f40a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-961854722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcba27e-bf64-42ba-8e82-a1c2fc4882ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91cfaba8cf240a5851fa60b365a7d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:44Z,use_quota=True,user_id='a43199182cc4495ca5ae8caf1d713db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eaaa5a5-e88a-400f-84a0-efac1c175b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eaaa5a5-e88a-400f-84a0-efac1c175b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a89222-2c47-4bc8-bc46-5df878f907a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a89222-2c47-4bc8-bc46-5df878f907a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bcba27e-bf64-42ba-8e82-a1c2fc4882ca', 'volume_name': 'volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d2a293-891d-4f9d-ac6b-454647dfcaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d2a293-891d-4f9d-ac6b-454647dfcaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8379d175-cdd9-4356-9503-f2db9c40efd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:44 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Volume 1bcba27e-bf64-42ba-8e82-a1c2fc4882ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca', 'volume_size': 1} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-961854722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcba27e-bf64-42ba-8e82-a1c2fc4882ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91cfaba8cf240a5851fa60b365a7d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:44Z,use_quota=True,user_id='a43199182cc4495ca5ae8caf1d713db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Creating volume 1bcba27e-bf64-42ba-8e82-a1c2fc4882ca {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:44 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:47:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:44 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca 1073741824 Nov 05 03:47:44 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Flow 'volume_create_manager' (689b4b0f-326a-4aa1-b1c4-182df08b98db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:45 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f823af5b-d7bf-41a8-af08-d4d6271b620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca 1073741824" returned: 0 in 1.407s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f823af5b-d7bf-41a8-af08-d4d6271b620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-886265391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209a920a-ddd6-4fc0-9eca-96d4a57df221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f374a941442aeb1addb2a6478c028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:45Z,use_quota=True,user_id='185b6ed365514fb992f04f6ffb57e4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68613872-8696-4196-b38a-ecf818a253a1),volume_type_id=68613872-8696-4196-b38a-ecf818a253a1)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562b2a97-7be0-43f4-a77c-3c2cf95a6b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562b2a97-7be0-43f4-a77c-3c2cf95a6b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d33faa1-e511-4e89-9a18-1c68ef1089ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d33faa1-e511-4e89-9a18-1c68ef1089ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209a920a-ddd6-4fc0-9eca-96d4a57df221', 'volume_name': 'volume-209a920a-ddd6-4fc0-9eca-96d4a57df221', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f1ffb2-d615-4497-8668-6b73e7dc2290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f1ffb2-d615-4497-8668-6b73e7dc2290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d021771-89f5-47bb-9cd1-66082300d7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:45 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Volume 209a920a-ddd6-4fc0-9eca-96d4a57df221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209a920a-ddd6-4fc0-9eca-96d4a57df221', 'volume_size': 1} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:45 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca Nov 05 03:47:45 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:46 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca" returned: 0 in 0.422s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-886265391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209a920a-ddd6-4fc0-9eca-96d4a57df221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f374a941442aeb1addb2a6478c028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:45Z,use_quota=True,user_id='185b6ed365514fb992f04f6ffb57e4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68613872-8696-4196-b38a-ecf818a253a1),volume_type_id=68613872-8696-4196-b38a-ecf818a253a1)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Creating volume 209a920a-ddd6-4fc0-9eca-96d4a57df221 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:46 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8379d175-cdd9-4356-9503-f2db9c40efd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:46 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 1073741824 Nov 05 03:47:46 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968656ad-afbb-4990-bb24-34eeeaa476fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:46 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Volume volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca (1bcba27e-bf64-42ba-8e82-a1c2fc4882ca): created successfully Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968656ad-afbb-4990-bb24-34eeeaa476fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Flow 'volume_create_manager' (ccb8dddb-d37c-4664-b9f7-d7af900dc1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f3ab74bb-2c54-4390-9c9f-7704692ca863 tempest-TestMinimumBasicScenario-1411060999 None] Created volume successfully. Nov 05 03:47:47 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 1073741824" returned: 0 in 1.388s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:47 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 Nov 05 03:47:47 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:48 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221" returned: 0 in 1.200s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] <== create_volume: return (2769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.795s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d021771-89f5-47bb-9cd1-66082300d7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209a920a-ddd6-4fc0-9eca-96d4a57df221', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409772ec-0196-49d8-bbfb-13f322ca13e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:49 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Volume volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 (209a920a-ddd6-4fc0-9eca-96d4a57df221): created successfully Nov 05 03:47:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409772ec-0196-49d8-bbfb-13f322ca13e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Flow 'volume_create_manager' (689b4b0f-326a-4aa1-b1c4-182df08b98db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-65cfcab0-d105-40f4-9ce6-1a0e697e95af tempest-VolumeTypesAccessTest-2017468535 None] Created volume successfully. Nov 05 03:47:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Acquiring lock "cinder-209a920a-ddd6-4fc0-9eca-96d4a57df221-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Lock "cinder-209a920a-ddd6-4fc0-9eca-96d4a57df221-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Acquiring lock "cinder-quobyte-209a920a-ddd6-4fc0-9eca-96d4a57df221" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Lock "cinder-quobyte-209a920a-ddd6-4fc0-9eca-96d4a57df221" acquired by "delete_volume" :: waited 0.039s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:51 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb380f7-c1d3-4d3c-9187-7f2a410061b5]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-6fa4e92a-2fe8-4abe-aff7-2f093c5bb734 req-956dbe57-ddec-4b00-a340-9010c9bf0a0c tempest-TestMinimumBasicScenario-1411060999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-6fa4e92a-2fe8-4abe-aff7-2f093c5bb734 req-956dbe57-ddec-4b00-a340-9010c9bf0a0c tempest-TestMinimumBasicScenario-1411060999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-6fa4e92a-2fe8-4abe-aff7-2f093c5bb734 req-956dbe57-ddec-4b00-a340-9010c9bf0a0c tempest-TestMinimumBasicScenario-1411060999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.066s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-6fa4e92a-2fe8-4abe-aff7-2f093c5bb734 req-956dbe57-ddec-4b00-a340-9010c9bf0a0c tempest-TestMinimumBasicScenario-1411060999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc84fb02-28b2-4711-a16b-11691d8e3bbb', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:47:51 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 Nov 05 03:47:51 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-6fa4e92a-2fe8-4abe-aff7-2f093c5bb734 req-956dbe57-ddec-4b00-a340-9010c9bf0a0c tempest-TestMinimumBasicScenario-1411060999 None] attachment_update completed successfully. Nov 05 03:47:52 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221" returned: 0 in 1.204s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:52 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221 Nov 05 03:47:52 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:52 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a920a-ddd6-4fc0-9eca-96d4a57df221" returned: 0 in 0.716s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Lock "cinder-quobyte-209a920a-ddd6-4fc0-9eca-96d4a57df221" released by "delete_volume" :: held 2.073s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:53 devstack cinder-volume[87111]: WARNING cinder.quota [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-690632128 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-690632128, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:47:53 devstack cinder-volume[87111]: WARNING cinder.quota [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-690632128 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-690632128, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Created reservations ['deb21730-e97c-4e71-854b-2679136813dd', '247666fe-e69c-4b70-9bf5-4e7b82bd2412', 'ba39b242-0e2a-47d4-bf30-75ab1f691625', '1ccf7135-9dbe-4e3d-bb0a-e2fe67954fe4'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:53 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:47:53 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:53 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.332s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Deleted volume successfully. Nov 05 03:47:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-caf217e0-9ddf-49e7-a83d-8368050de96a tempest-VolumeTypesAccessTest-2017468535 None] Lock "cinder-209a920a-ddd6-4fc0-9eca-96d4a57df221-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:03 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=20,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:48:03 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=26,cinder:UPDATE=17,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Flow 'volume_create_manager' (bb28c499-593f-44f8-9fdc-5dde648e7588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0a0ac4-76e4-4f2b-90d8-ebcce223cf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0a0ac4-76e4-4f2b-90d8-ebcce223cf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1358902529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4271e7-44c6-4ff0-bf51-63f06508b015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2d59d28e6f4b599b9307e4d3456047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:12Z,use_quota=True,user_id='8b987082563f475b9254632f0e5b9958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc39ad5e-64c0-4bbc-822c-cd524bce5ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc39ad5e-64c0-4bbc-822c-cd524bce5ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48bf3785-3a05-440c-a0e5-37db71133472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48bf3785-3a05-440c-a0e5-37db71133472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b4271e7-44c6-4ff0-bf51-63f06508b015', 'volume_name': 'volume-0b4271e7-44c6-4ff0-bf51-63f06508b015', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c5b76d-7a02-4353-8112-caeaa2b42aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c5b76d-7a02-4353-8112-caeaa2b42aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449444b1-1fb5-4a20-9ba9-21e188ba2db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Volume 0b4271e7-44c6-4ff0-bf51-63f06508b015: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b4271e7-44c6-4ff0-bf51-63f06508b015', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:48:11 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Trying to clone 0b4271e7-44c6-4ff0-bf51-63f06508b015 from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:48:12 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:48:12 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:48:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e56fb11-7de5-401f-8096-7d8d3398831a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:12 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD Nov 05 03:48:12 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:12 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:12 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 is fetched for user 8b987082563f475b9254632f0e5b9958. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:48:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54ae0d8-00d9-4186-be7e-27d4a993afad]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:12 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD Nov 05 03:48:12 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:13 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1358902529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4271e7-44c6-4ff0-bf51-63f06508b015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2d59d28e6f4b599b9307e4d3456047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:12Z,use_quota=True,user_id='8b987082563f475b9254632f0e5b9958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Creating volume 0b4271e7-44c6-4ff0-bf51-63f06508b015 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:13 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:13 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 1073741824 Nov 05 03:48:13 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:13 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 1073741824" returned: 0 in 0.449s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:13 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 Nov 05 03:48:13 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:13 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015" returned: 0 in 0.291s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Attempting download of f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume 0b4271e7-44c6-4ff0-bf51-63f06508b015. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1104838-7f7d-419c-9f96-9e7581ac20a1]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_93ijazg7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:14 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_93ijazg7 Nov 05 03:48:14 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:14 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_93ijazg7" returned: 0 in 0.389s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_93ijazg7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:14 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_93ijazg7 Nov 05 03:48:14 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:14 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_93ijazg7" returned: 1 in 0.363s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_93ijazg7' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:48:14 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7aa09c-a381-40b0-b85c-82fbded69e97]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:14 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD Nov 05 03:48:14 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:15 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] f813bdfc-9ad7-4949-b238-678b8d2b8f65 was qcow2, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:15 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 Nov 05 03:48:15 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:15 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:48:15 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:15 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.332s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:48:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:48:17 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015" returned: 0 in 2.551s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:17 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_cl75ghoodevstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:48:17 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Converted 112.00 MB image at 43.88 MB/s Nov 05 03:48:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:17 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 1G Nov 05 03:48:17 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:18 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 1G" returned: 0 in 0.363s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Downloaded image f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume 0b4271e7-44c6-4ff0-bf51-63f06508b015 successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 for user 8b987082563f475b9254632f0e5b9958 is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Marking volume 0b4271e7-44c6-4ff0-bf51-63f06508b015 as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Copying metadata from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 to 0b4271e7-44c6-4ff0-bf51-63f06508b015. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Creating volume glance metadata for volume 0b4271e7-44c6-4ff0-bf51-63f06508b015 backed by image f813bdfc-9ad7-4949-b238-678b8d2b8f65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449444b1-1fb5-4a20-9ba9-21e188ba2db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b4271e7-44c6-4ff0-bf51-63f06508b015', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494998c5-ddcb-4d3f-bcb3-b6d7ab8cfdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:18 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Volume volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 (0b4271e7-44c6-4ff0-bf51-63f06508b015): created successfully Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494998c5-ddcb-4d3f-bcb3-b6d7ab8cfdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Flow 'volume_create_manager' (bb28c499-593f-44f8-9fdc-5dde648e7588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a59e55f8-bd13-48ee-ac3b-7f4b1d1bbe54 tempest-VolumesImageMetadata-1440782659 None] Created volume successfully. Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Flow 'volume_create_manager' (df0a120a-3519-407c-8697-fcadf5106b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7faae155-286e-4b14-b2b3-60fa270d0ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7faae155-286e-4b14-b2b3-60fa270d0ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1359279637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81641c2-5dfe-4afa-8558-0ba04256be26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9a803bcf2a4b889d33e7caf3735358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:19Z,use_quota=True,user_id='f0642a9277474f4da92cd0dae21b3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef00ca64-74d8-4ce9-96a0-8e64b2f01066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef00ca64-74d8-4ce9-96a0-8e64b2f01066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3017b4b-d946-4a28-b4f4-8400f599b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3017b4b-d946-4a28-b4f4-8400f599b74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81641c2-5dfe-4afa-8558-0ba04256be26', 'volume_name': 'volume-d81641c2-5dfe-4afa-8558-0ba04256be26', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9646b8-1e39-423e-aad0-bbc911f567b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9646b8-1e39-423e-aad0-bbc911f567b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8e0505-2a6c-4e15-a4ba-cf1da11a5b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:19 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Volume d81641c2-5dfe-4afa-8558-0ba04256be26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81641c2-5dfe-4afa-8558-0ba04256be26', 'volume_size': 1} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1359279637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81641c2-5dfe-4afa-8558-0ba04256be26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9a803bcf2a4b889d33e7caf3735358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:19Z,use_quota=True,user_id='f0642a9277474f4da92cd0dae21b3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Creating volume d81641c2-5dfe-4afa-8558-0ba04256be26 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:19 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:19 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 1073741824 Nov 05 03:48:19 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Acquiring lock "cinder-0b4271e7-44c6-4ff0-bf51-63f06508b015-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Lock "cinder-0b4271e7-44c6-4ff0-bf51-63f06508b015-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Acquiring lock "cinder-quobyte-0b4271e7-44c6-4ff0-bf51-63f06508b015" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:19 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Lock "cinder-quobyte-0b4271e7-44c6-4ff0-bf51-63f06508b015" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 1073741824" returned: 0 in 0.541s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ad3028-2b38-4c64-bba4-1c194cc61b29]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:19 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 Nov 05 03:48:19 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:19 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 Nov 05 03:48:19 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:20 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8e0505-2a6c-4e15-a4ba-cf1da11a5b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81641c2-5dfe-4afa-8558-0ba04256be26', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693fdde6-cf09-4f27-bf0d-a1e90687ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Volume volume-d81641c2-5dfe-4afa-8558-0ba04256be26 (d81641c2-5dfe-4afa-8558-0ba04256be26): created successfully Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693fdde6-cf09-4f27-bf0d-a1e90687ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Flow 'volume_create_manager' (df0a120a-3519-407c-8697-fcadf5106b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:20 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015" returned: 0 in 0.422s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d29b4855-68ee-4fb2-bea1-e9620470dd61 tempest-AttachVolumeTestJSON-636569192 None] Created volume successfully. Nov 05 03:48:20 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015 Nov 05 03:48:20 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:20 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0b4271e7-44c6-4ff0-bf51-63f06508b015" returned: 0 in 0.289s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Lock "cinder-quobyte-0b4271e7-44c6-4ff0-bf51-63f06508b015" released by "delete_volume" :: held 0.755s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Created reservations ['5c8fcf4d-cc1f-444f-9a5b-6e3b44da60ab', '82e71e77-008c-47f4-ad17-5610771008c1', 'ae483104-3aaf-43b9-9216-8e20a78ee6d9', '2d030f1e-241c-4819-a24c-a114577083e4'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:20 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:48:20 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:20 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.273s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Deleted volume successfully. Nov 05 03:48:20 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-462ba6c6-cb8a-424e-8088-874a2627c04d tempest-VolumesImageMetadata-1440782659 None] Lock "cinder-0b4271e7-44c6-4ff0-bf51-63f06508b015-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-a3eda06e-6387-42d9-aa41-d9de7e378e3c req-1030cb8d-dee9-491c-bdfd-931e86d9e13e tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-a3eda06e-6387-42d9-aa41-d9de7e378e3c req-1030cb8d-dee9-491c-bdfd-931e86d9e13e tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-a3eda06e-6387-42d9-aa41-d9de7e378e3c req-1030cb8d-dee9-491c-bdfd-931e86d9e13e tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:22 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-a3eda06e-6387-42d9-aa41-d9de7e378e3c req-1030cb8d-dee9-491c-bdfd-931e86d9e13e tempest-AttachVolumeTestJSON-636569192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-d81641c2-5dfe-4afa-8558-0ba04256be26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d2ac7c1-313c-4cf5-9a63-e5846309a234', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:48:22 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-a3eda06e-6387-42d9-aa41-d9de7e378e3c req-1030cb8d-dee9-491c-bdfd-931e86d9e13e tempest-AttachVolumeTestJSON-636569192 None] attachment_update completed successfully. Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Flow 'volume_create_manager' (fefab459-7ab6-48db-8701-dbfed29a5b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9ad573-8983-42db-9423-345fd250e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9ad573-8983-42db-9423-345fd250e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-248418628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666c4ae6-a155-4d57-a9d1-3be4080a6bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9a803bcf2a4b889d33e7caf3735358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:24Z,use_quota=True,user_id='f0642a9277474f4da92cd0dae21b3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6c1f49-531f-4817-aea8-eaa75d7b9ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6c1f49-531f-4817-aea8-eaa75d7b9ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8013e399-52d9-4cb5-8a08-fa2bf99207c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8013e399-52d9-4cb5-8a08-fa2bf99207c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666c4ae6-a155-4d57-a9d1-3be4080a6bb9', 'volume_name': 'volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7672fe-150a-4149-9389-e73c6946b22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7672fe-150a-4149-9389-e73c6946b22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca819dc-7e26-4d23-883e-ca8b997ea314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Volume 666c4ae6-a155-4d57-a9d1-3be4080a6bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9', 'volume_size': 1} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-248418628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666c4ae6-a155-4d57-a9d1-3be4080a6bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9a803bcf2a4b889d33e7caf3735358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:24Z,use_quota=True,user_id='f0642a9277474f4da92cd0dae21b3c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Creating volume 666c4ae6-a155-4d57-a9d1-3be4080a6bb9 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:23 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:48:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:23 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 1073741824 Nov 05 03:48:23 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:24 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 1073741824" returned: 0 in 0.559s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:24 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 Nov 05 03:48:24 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:24 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9" returned: 0 in 0.312s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca819dc-7e26-4d23-883e-ca8b997ea314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baba57ce-156e-4607-94d8-c7f026cb93f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Volume volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 (666c4ae6-a155-4d57-a9d1-3be4080a6bb9): created successfully Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baba57ce-156e-4607-94d8-c7f026cb93f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Flow 'volume_create_manager' (fefab459-7ab6-48db-8701-dbfed29a5b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d0e541d6-826a-459f-80d7-4d94a83edbe1 tempest-AttachVolumeTestJSON-636569192 None] Created volume successfully. Nov 05 03:48:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-baf14678-3a4b-4bd3-9534-9b109abae31b req-7eeccba4-cbc9-4d81-9991-c88cbe6be455 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-baf14678-3a4b-4bd3-9534-9b109abae31b req-7eeccba4-cbc9-4d81-9991-c88cbe6be455 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-baf14678-3a4b-4bd3-9534-9b109abae31b req-7eeccba4-cbc9-4d81-9991-c88cbe6be455 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-baf14678-3a4b-4bd3-9534-9b109abae31b req-7eeccba4-cbc9-4d81-9991-c88cbe6be455 tempest-AttachVolumeTestJSON-636569192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26121fb9-b83d-4575-b639-13a3ee633e4b', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:48:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-baf14678-3a4b-4bd3-9534-9b109abae31b req-7eeccba4-cbc9-4d81-9991-c88cbe6be455 tempest-AttachVolumeTestJSON-636569192 None] attachment_update completed successfully. Nov 05 03:48:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-483a8759-496d-4cd0-9ba8-4a235b302a77 req-3cfb3877-619b-4bb1-9e77-5fd58823e9c9 tempest-AttachVolumeTestJSON-636569192 None] Terminate volume connection completed successfully. Nov 05 03:48:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-483a8759-496d-4cd0-9ba8-4a235b302a77 req-3cfb3877-619b-4bb1-9e77-5fd58823e9c9 tempest-AttachVolumeTestJSON-636569192 None] Deleting attachment 9d2ac7c1-313c-4cf5-9a63-e5846309a234. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:48:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-748ff147-8583-4a0e-a195-2cddae6c4105 req-8384df63-fb61-4ef6-8325-c1ad412538b4 tempest-AttachVolumeTestJSON-636569192 None] Terminate volume connection completed successfully. Nov 05 03:48:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-748ff147-8583-4a0e-a195-2cddae6c4105 req-8384df63-fb61-4ef6-8325-c1ad412538b4 tempest-AttachVolumeTestJSON-636569192 None] Deleting attachment 26121fb9-b83d-4575-b639-13a3ee633e4b. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:48:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-6340a3f3-7a38-416b-8281-11f72b260826 req-e3594b99-fe21-4715-818d-acef62ebcf86 tempest-ServerActionsTestOtherA-1758953836 None] Terminate volume connection completed successfully. Nov 05 03:48:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-6340a3f3-7a38-416b-8281-11f72b260826 req-e3594b99-fe21-4715-818d-acef62ebcf86 tempest-ServerActionsTestOtherA-1758953836 None] Deleting attachment 17021e94-b725-4358-b8ff-8aaa8e60cf6a. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:48:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "cinder-b8dd3604-b652-4dc5-bd32-68088ab6e990-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Lock "cinder-b8dd3604-b652-4dc5-bd32-68088ab6e990-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "cinder-quobyte-b8dd3604-b652-4dc5-bd32-68088ab6e990" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Lock "cinder-quobyte-b8dd3604-b652-4dc5-bd32-68088ab6e990" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:32 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b34c675-7d63-4ae7-aad3-b855d600d7d9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:32 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 Nov 05 03:48:32 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:32 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990" returned: 0 in 0.721s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:32 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990 Nov 05 03:48:32 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "cinder-3f721da2-fd0e-42e4-b63c-2d4f88af112b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Lock "cinder-3f721da2-fd0e-42e4-b63c-2d4f88af112b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "cinder-quobyte-3f721da2-fd0e-42e4-b63c-2d4f88af112b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Lock "cinder-quobyte-3f721da2-fd0e-42e4-b63c-2d4f88af112b" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:33 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b8dd3604-b652-4dc5-bd32-68088ab6e990" returned: 0 in 0.349s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Lock "cinder-quobyte-b8dd3604-b652-4dc5-bd32-68088ab6e990" released by "delete_volume" :: held 1.155s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03ef8e1-e5e2-4e51-aa0b-7693fd690eb3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.quota [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Created reservations ['2e11feae-37de-4fb5-8ddb-5350060a2f73', 'b4b60490-096f-4007-bd32-e269591c2814', '3bb4b175-1669-4fa2-b5ee-a0a026f5e8e2', '35e16306-d30f-4b94-8218-7b9cf0ff80c9'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:33 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b Nov 05 03:48:33 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:33 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:48:33 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:33 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b" returned: 0 in 0.537s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:33 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b Nov 05 03:48:33 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:33 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.403s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.manager [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:33 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Deleted volume successfully. Nov 05 03:48:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-6340a3f3-7a38-416b-8281-11f72b260826 req-55205bbf-d40f-42ad-be67-3dfd393a6b7b tempest-ServerActionsTestOtherA-1758953836 None] Lock "cinder-b8dd3604-b652-4dc5-bd32-68088ab6e990-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:34 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3f721da2-fd0e-42e4-b63c-2d4f88af112b" returned: 0 in 0.282s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Lock "cinder-quobyte-3f721da2-fd0e-42e4-b63c-2d4f88af112b" released by "delete_volume" :: held 0.881s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Created reservations ['aec4c9d0-930c-443b-80c2-313e53eaaf95', '74538503-f400-400c-91ef-03451761c65f', 'e3392adf-7c92-44dc-9f94-095e0b7326e7', '8778cbcb-e498-4db0-8c76-6a829caa8c74'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:34 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:48:34 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:34 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.342s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:34 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Deleted volume successfully. Nov 05 03:48:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-355201b8-7b13-49fe-b1f3-261f6a624e1c tempest-ServerActionsTestOtherA-1758953836 None] Lock "cinder-3f721da2-fd0e-42e4-b63c-2d4f88af112b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "cinder-666c4ae6-a155-4d57-a9d1-3be4080a6bb9-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-666c4ae6-a155-4d57-a9d1-3be4080a6bb9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "cinder-quobyte-666c4ae6-a155-4d57-a9d1-3be4080a6bb9" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-quobyte-666c4ae6-a155-4d57-a9d1-3be4080a6bb9" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:38 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab44a411-f17c-4508-a73d-98a24549b00c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:38 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 Nov 05 03:48:38 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:38 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9" returned: 0 in 0.452s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:39 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9 Nov 05 03:48:39 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:39 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-666c4ae6-a155-4d57-a9d1-3be4080a6bb9" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-quobyte-666c4ae6-a155-4d57-a9d1-3be4080a6bb9" released by "delete_volume" :: held 0.814s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Created reservations ['bfb91538-9b26-45e5-8786-b3b8acd21db5', 'ac121a92-4f7e-4c16-9a3d-5742cf736143', '320a3c81-0b7d-498b-b6e3-91add530f092', '0db9836b-6255-4936-bdae-3121a6d78bff'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:39 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:48:39 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "cinder-d81641c2-5dfe-4afa-8558-0ba04256be26-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-d81641c2-5dfe-4afa-8558-0ba04256be26-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "cinder-quobyte-d81641c2-5dfe-4afa-8558-0ba04256be26" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-quobyte-d81641c2-5dfe-4afa-8558-0ba04256be26" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd24bf0b-f65e-45d6-81ad-65aed26aaa09]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:39 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.327s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Deleted volume successfully. Nov 05 03:48:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-67121aa0-25eb-49b7-9cf7-43ee709b33b8 tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-666c4ae6-a155-4d57-a9d1-3be4080a6bb9-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:39 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 Nov 05 03:48:39 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:40 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26" returned: 0 in 0.439s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:40 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26 Nov 05 03:48:40 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d81641c2-5dfe-4afa-8558-0ba04256be26" returned: 0 in 0.283s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:40 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-quobyte-d81641c2-5dfe-4afa-8558-0ba04256be26" released by "delete_volume" :: held 0.796s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Flow 'volume_create_manager' (91e46983-d7f3-4dfe-9966-eaa501f25053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5900722a-60b6-4767-85fd-4f5408875f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5900722a-60b6-4767-85fd-4f5408875f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-936972265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8045aa-eec9-47e4-a622-b13b2aa9bd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbfbc4da1654e9fb7fe1ff3b867fa94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:40Z,use_quota=True,user_id='cdf80c3220a3417a93274cf3e2da3983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41759407-7f93-49b9-b404-6401f78123ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41759407-7f93-49b9-b404-6401f78123ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aadc9b78-8aba-4177-b1a1-b15d09fb36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aadc9b78-8aba-4177-b1a1-b15d09fb36f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8045aa-eec9-47e4-a622-b13b2aa9bd70', 'volume_name': 'volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e0409-f9e4-443e-a4dd-9835e94c76d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e0409-f9e4-443e-a4dd-9835e94c76d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fca8bb-db5c-4ac1-95d3-81cd3a25dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:40 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Volume ba8045aa-eec9-47e4-a622-b13b2aa9bd70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70', 'volume_size': 1} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-936972265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8045aa-eec9-47e4-a622-b13b2aa9bd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbfbc4da1654e9fb7fe1ff3b867fa94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:40Z,use_quota=True,user_id='cdf80c3220a3417a93274cf3e2da3983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Creating volume ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:40 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:40 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 1073741824 Nov 05 03:48:40 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Created reservations ['194e33b5-f1a1-4860-9241-46adec2cfa79', '28fa54ed-aebc-44ec-b997-e5e67610726b', '42b6f5f5-1fec-4a32-9421-c2a9e2cd5302', '134ce304-1da0-4ae7-be02-9816e1292e65'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:40 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:48:40 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "cinder-d84f56a4-23fa-4cf9-8408-4b477ec067a1-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-d84f56a4-23fa-4cf9-8408-4b477ec067a1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "cinder-quobyte-d84f56a4-23fa-4cf9-8408-4b477ec067a1" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-quobyte-d84f56a4-23fa-4cf9-8408-4b477ec067a1" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4202d3f3-703f-4452-b75c-e1c9058b836e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:41 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.382s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:41 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Deleted volume successfully. Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0e43956-7079-4b59-bdf2-223795cb668d tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-d81641c2-5dfe-4afa-8558-0ba04256be26-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:41 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 1073741824" returned: 0 in 0.623s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:41 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 Nov 05 03:48:41 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:41 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:48:41 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:41 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:41 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1" returned: 0 in 0.481s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.313s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:41 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1 Nov 05 03:48:41 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fca8bb-db5c-4ac1-95d3-81cd3a25dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1a3ed6-bc67-4d87-9237-2514ab0febcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:41 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Volume volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 (ba8045aa-eec9-47e4-a622-b13b2aa9bd70): created successfully Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1a3ed6-bc67-4d87-9237-2514ab0febcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Flow 'volume_create_manager' (91e46983-d7f3-4dfe-9966-eaa501f25053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:41 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6008d33b-8a21-445e-92c9-c42bed52e6b6 tempest-VolumesActionsTest-310279607 None] Created volume successfully. Nov 05 03:48:41 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d84f56a4-23fa-4cf9-8408-4b477ec067a1" returned: 0 in 0.255s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-quobyte-d84f56a4-23fa-4cf9-8408-4b477ec067a1" released by "delete_volume" :: held 0.790s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:41 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Created reservations ['1acc5919-4453-4008-8635-8fe18758c0ee', 'bd826346-fc1b-4b51-a365-b4330b8b44ae', 'bb778400-fc60-4131-9c4a-6c2b168449b9', 'db06d43f-755c-4f5b-8e8d-989c576181f3'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:42 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:48:42 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:42 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:42 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Deleted volume successfully. Nov 05 03:48:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bd1464bb-1522-4047-a88d-d9ad5c6f4319 tempest-AttachVolumeTestJSON-636569192 None] Lock "cinder-d84f56a4-23fa-4cf9-8408-4b477ec067a1-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:52 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=60,cinder:SELECT=61,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:48:52 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=75,cinder:UPDATE=70,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:48:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0f8a600b-b2b6-4c8f-be20-8da6a0546f7f tempest-VolumesActionsTest-310279607 None] Acquiring lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" by "attach_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0f8a600b-b2b6-4c8f-be20-8da6a0546f7f tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" acquired by "attach_volume" :: waited 0.046s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0f8a600b-b2b6-4c8f-be20-8da6a0546f7f tempest-VolumesActionsTest-310279607 None] Attaching volume ba8045aa-eec9-47e4-a622-b13b2aa9bd70 to instance 5ab7692e-1ac5-4712-8cbb-4abd809242d1 at mountpoint /dev/vdb on host None. Nov 05 03:48:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0f8a600b-b2b6-4c8f-be20-8da6a0546f7f tempest-VolumesActionsTest-310279607 None] Attach volume completed successfully. Nov 05 03:48:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0f8a600b-b2b6-4c8f-be20-8da6a0546f7f tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" released by "attach_volume" :: held 0.212s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d1f6645-e11b-4c35-a73c-8947262183db tempest-VolumesActionsTest-310279607 None] Acquiring lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-detach_volume" by "detach_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d1f6645-e11b-4c35-a73c-8947262183db tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6d1f6645-e11b-4c35-a73c-8947262183db tempest-VolumesActionsTest-310279607 None] Detaching volume ba8045aa-eec9-47e4-a622-b13b2aa9bd70 from instance 5ab7692e-1ac5-4712-8cbb-4abd809242d1. Nov 05 03:48:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6d1f6645-e11b-4c35-a73c-8947262183db tempest-VolumesActionsTest-310279607 None] Detach volume completed successfully. Nov 05 03:48:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6d1f6645-e11b-4c35-a73c-8947262183db tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-detach_volume" released by "detach_volume" :: held 0.192s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c12b7843-6796-409f-ac02-af202811d209 tempest-BackendsCapabilitiesAdminTestsJSON-1327035802 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87111) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Nov 05 03:48:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ba5cd285-ee59-4573-92e4-7291a9e22c9c tempest-BackendsCapabilitiesAdminTestsJSON-1327035802 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87111) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Nov 05 03:48:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-0ceb1957-1d26-4f1c-b223-4d5d5975e6f5 req-63ecf0e1-7379-46d8-93d1-0528f2096036 tempest-TestMinimumBasicScenario-1411060999 None] Terminate volume connection completed successfully. Nov 05 03:48:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-0ceb1957-1d26-4f1c-b223-4d5d5975e6f5 req-63ecf0e1-7379-46d8-93d1-0528f2096036 tempest-TestMinimumBasicScenario-1411060999 None] Deleting attachment dc84fb02-28b2-4711-a16b-11691d8e3bbb. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:48:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Acquiring lock "cinder-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Lock "cinder-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Acquiring lock "cinder-quobyte-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Lock "cinder-quobyte-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:59 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02b5da4-b4db-4fb0-bfeb-104182bbbe21]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:59 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca Nov 05 03:48:59 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:59 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca" returned: 0 in 0.525s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:59 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca Nov 05 03:48:59 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:00 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca" returned: 0 in 0.296s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Lock "cinder-quobyte-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca" released by "delete_volume" :: held 0.911s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Created reservations ['85d60394-940d-4a9c-b8b9-55435a622d95', '3bca2e45-6c3d-4d54-adb8-319b3296296f', '9cb5d058-e12b-4274-9d1d-f3f1526c0afc', '2177c633-6567-487b-899d-bf2057d5797d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:00 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:49:00 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:00 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.399s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:00 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Deleted volume successfully. Nov 05 03:49:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-930df99f-e9c4-4be1-88fa-18c742617eb3 tempest-TestMinimumBasicScenario-1411060999 None] Lock "cinder-1bcba27e-bf64-42ba-8e82-a1c2fc4882ca-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:10 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:INSERT=3,cinder:SELECT=14,cinder:UPDATE=10 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:49:10 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:49:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-65e9859f-fcd4-43ea-a41b-c4fa28cf3203 tempest-GroupSnapshotsTest-579333233 None] Group tempest-GroupSnapshotsTest-Group-1565753163: creating Nov 05 03:49:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-65e9859f-fcd4-43ea-a41b-c4fa28cf3203 tempest-GroupSnapshotsTest-579333233 None] Group tempest-GroupSnapshotsTest-Group-1565753163: created successfully Nov 05 03:49:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-65e9859f-fcd4-43ea-a41b-c4fa28cf3203 tempest-GroupSnapshotsTest-579333233 None] Create group completed successfully. Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Flow 'volume_create_manager' (1e466cb4-a471-4d65-adf1-2e3116e3e7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c55d25-e985-4fc9-845c-58143ba5511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c55d25-e985-4fc9-845c-58143ba5511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-698741679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08d02224-1f32-4d9d-982f-84d0700a4d07,host='devstack@QuobyteHD#QuobyteHD',id=aafa1ee0-0f1e-4380-9c38-eefb4a076aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7acfca222a4123a1cf39871cef7cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:12Z,use_quota=True,user_id='04fa6de67c134d2d817b5412bca41a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d021bf0-77a7-49d0-9475-3b0922b3a9d5),volume_type_id=1d021bf0-77a7-49d0-9475-3b0922b3a9d5)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4e75a1-1353-439a-babb-67b88a9732ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4e75a1-1353-439a-babb-67b88a9732ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ebe0a4-a888-4233-9162-58278f451e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ebe0a4-a888-4233-9162-58278f451e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafa1ee0-0f1e-4380-9c38-eefb4a076aa3', 'volume_name': 'volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cc6d2a-b916-41ad-8728-85667e7ed487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cc6d2a-b916-41ad-8728-85667e7ed487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5402ad-0a9e-410e-a32f-2c55acd46807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Volume aafa1ee0-0f1e-4380-9c38-eefb4a076aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3', 'volume_size': 1} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08d02224-1f32-4d9d-982f-84d0700a4d07,created_at=2026-11-05T02:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-698741679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08d02224-1f32-4d9d-982f-84d0700a4d07,host='devstack@QuobyteHD#QuobyteHD',id=aafa1ee0-0f1e-4380-9c38-eefb4a076aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7acfca222a4123a1cf39871cef7cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:12Z,use_quota=True,user_id='04fa6de67c134d2d817b5412bca41a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d021bf0-77a7-49d0-9475-3b0922b3a9d5),volume_type_id=1d021bf0-77a7-49d0-9475-3b0922b3a9d5)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Creating volume aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:12 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:49:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:12 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 1073741824 Nov 05 03:49:12 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:13 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 1073741824" returned: 0 in 0.647s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:13 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 Nov 05 03:49:13 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:13 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5402ad-0a9e-410e-a32f-2c55acd46807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2129b16-c005-46f7-93d2-49b73abb4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:13 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Volume volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 (aafa1ee0-0f1e-4380-9c38-eefb4a076aa3): created successfully Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2129b16-c005-46f7-93d2-49b73abb4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Flow 'volume_create_manager' (1e466cb4-a471-4d65-adf1-2e3116e3e7ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-eeae2171-c676-4a75-908b-6e2e55004e2a tempest-GroupSnapshotsTest-579333233 None] Created volume successfully. Nov 05 03:49:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] GroupSnapshot 0db25edd-18ab-46bc-b41f-cfd03f6e104b: creating. Nov 05 03:49:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Group snapshot 0db25edd-18ab-46bc-b41f-cfd03f6e104b: creating. {{(pid=87111) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Nov 05 03:49:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Creating offline snapshot 6a348d74-5ab5-47b4-8c16-c0703a3c0de9 of volume aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:14 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b6b8c6-d6ae-49a6-a38d-5c0f5ac5a814]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:14 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 Nov 05 03:49:14 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:15 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" returned: 0 in 0.466s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:15 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 1G Nov 05 03:49:15 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:15 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:49:15 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:15 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 1G" returned: 0 in 0.635s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:15 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.431s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:49:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:49:15 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 Nov 05 03:49:15 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:16 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9" returned: 0 in 0.392s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:16 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:49:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:16 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 Nov 05 03:49:16 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:16 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9" returned: 0 in 0.795s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:17 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.info Nov 05 03:49:17 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:17 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.info" returned: 0 in 0.678s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:17 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:49:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:17 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.info Nov 05 03:49:17 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:18 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.info" returned: 0 in 0.841s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ce1a171c-724b-4e41-97a9-b9afb2e50b3c tempest-GroupSnapshotsTest-579333233 None] group_snapshot 0db25edd-18ab-46bc-b41f-cfd03f6e104b: created successfully Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-6a348d74-5ab5-47b4-8c16-c0703a3c0de9-a5579285-1edc-43da-b348-fda80aa5e9a7" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-6a348d74-5ab5-47b4-8c16-c0703a3c0de9-a5579285-1edc-43da-b348-fda80aa5e9a7" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Creating volume a5579285-1edc-43da-b348-fda80aa5e9a7 from snapshot 6a348d74-5ab5-47b4-8c16-c0703a3c0de9 {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-a5579285-1edc-43da-b348-fda80aa5e9a7" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-a5579285-1edc-43da-b348-fda80aa5e9a7" acquired by "_copy_volume_from_snapshot" :: waited 0.073s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] snapshot: 6a348d74-5ab5-47b4-8c16-c0703a3c0de9, volume: a5579285-1edc-43da-b348-fda80aa5e9a7, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf83fe1-a2cb-475b-a1f6-321bbe331ebd]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:21 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 Nov 05 03:49:21 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:22 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9" returned: 0 in 0.682s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce996bd7-f5ed-498b-9b1a-7fb4f73836ca]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:22 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 Nov 05 03:49:22 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:22 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" returned: 0 in 0.556s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:49:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:22 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 Nov 05 03:49:22 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4058c2e6-8110-4ad4-8f20-b05f548de237 tempest-VolumesActionsTest-310279607 None] Acquiring lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" by "attach_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4058c2e6-8110-4ad4-8f20-b05f548de237 tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" acquired by "attach_volume" :: waited 0.078s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:25 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4058c2e6-8110-4ad4-8f20-b05f548de237 tempest-VolumesActionsTest-310279607 None] Attaching volume ba8045aa-eec9-47e4-a622-b13b2aa9bd70 to instance c77bd457-f3bd-4333-b534-d4a80c39ec13 at mountpoint /dev/vdb on host None. Nov 05 03:49:25 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4058c2e6-8110-4ad4-8f20-b05f548de237 tempest-VolumesActionsTest-310279607 None] Attach volume completed successfully. Nov 05 03:49:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4058c2e6-8110-4ad4-8f20-b05f548de237 tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" released by "attach_volume" :: held 0.405s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-474b48c0-bf6b-44a6-9477-de5f373a3d54 tempest-VolumesActionsTest-310279607 None] Acquiring lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-detach_volume" by "detach_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-474b48c0-bf6b-44a6-9477-de5f373a3d54 tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:26 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-474b48c0-bf6b-44a6-9477-de5f373a3d54 tempest-VolumesActionsTest-310279607 None] Detaching volume ba8045aa-eec9-47e4-a622-b13b2aa9bd70 from instance c77bd457-f3bd-4333-b534-d4a80c39ec13. Nov 05 03:49:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-474b48c0-bf6b-44a6-9477-de5f373a3d54 tempest-VolumesActionsTest-310279607 None] Detach volume completed successfully. Nov 05 03:49:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-474b48c0-bf6b-44a6-9477-de5f373a3d54 tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-detach_volume" released by "detach_volume" :: held 0.261s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:34 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7" returned: 0 in 12.030s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:34 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3, size 1024.00 MB, duration 12.03 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:49:34 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Converted 1024.00 MB image at 85.11 MB/s Nov 05 03:49:34 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:49:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:34 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 Nov 05 03:49:34 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:35 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7" returned: 0 in 0.391s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-a5579285-1edc-43da-b348-fda80aa5e9a7" released by "_copy_volume_from_snapshot" :: held 13.869s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-6a348d74-5ab5-47b4-8c16-c0703a3c0de9-a5579285-1edc-43da-b348-fda80aa5e9a7" released by "_create_volume_from_snapshot" :: held 14.045s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.096s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:35 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5f50cc31-1fda-4e33-a252-c77bf4220861 tempest-GroupSnapshotsTest-579333233 None] Create group from source-snapshot-0db25edd-18ab-46bc-b41f-cfd03f6e104b completed successfully. Nov 05 03:49:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-a5579285-1edc-43da-b348-fda80aa5e9a7" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-a5579285-1edc-43da-b348-fda80aa5e9a7" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:36 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a9e1e-9c91-4ef7-be35-cf1ad5bc743a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:36 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 Nov 05 03:49:36 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:37 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7" returned: 0 in 0.633s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:37 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7 Nov 05 03:49:37 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (ff8f4d8a-32ef-45aa-94cb-374de37adcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ff8d6-7017-4579-86e4-337c931148ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ff8d6-7017-4579-86e4-337c931148ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-781804026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:38Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300bb091-0647-4932-ab1a-10cb17c1b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300bb091-0647-4932-ab1a-10cb17c1b179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e27625-9ad4-4720-80de-d2670d4668e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e27625-9ad4-4720-80de-d2670d4668e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1', 'volume_name': 'volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a89399-f96e-4db5-8d83-16c8448d8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a89399-f96e-4db5-8d83-16c8448d8619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2053ef7-0951-4e21-99af-f601899313ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:37 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1', 'volume_size': 1} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-781804026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:38Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Creating volume c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:37 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:37 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:37 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 1073741824 Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5579285-1edc-43da-b348-fda80aa5e9a7" returned: 0 in 0.592s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:37 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-a5579285-1edc-43da-b348-fda80aa5e9a7" released by "delete_volume" :: held 1.342s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Created reservations ['edbe85d5-03de-48ee-b598-e15020c98c92'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:38 devstack cinder-volume[87111]: WARNING cinder.quota [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1354765785 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1354765785, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:49:38 devstack cinder-volume[87111]: WARNING cinder.quota [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1354765785 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1354765785, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Created reservations ['583cf307-28c0-4be6-a097-1f318744dc4d', '52c9042b-054a-45b4-8b25-c9763d23e329', 'd577d823-7680-419d-8d8b-c51af1fffab2', 'd47c1c0e-10f8-4885-9e02-2da94c7980d9'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:38 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:49:38 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:38 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 1073741824" returned: 0 in 0.989s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:38 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.389s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:38 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-497b7cb2-bf0d-4f40-af15-cae840798a2c tempest-GroupSnapshotsTest-579333233 None] Delete group completed successfully. Nov 05 03:49:38 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 Nov 05 03:49:38 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:39 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" returned: 0 in 0.321s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2053ef7-0951-4e21-99af-f601899313ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd127a97-d325-47fa-8e96-d31089f84f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:39 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 (c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1): created successfully Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd127a97-d325-47fa-8e96-d31089f84f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (ff8f4d8a-32ef-45aa-94cb-374de37adcba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2de93583-c524-4043-878b-226631dd316a tempest-CreateVolumesFromSnapshotTest-132045559 None] Created volume successfully. Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1f23a-9c76-4e4a-9243-49dd2f21a9ac]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:39 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:49:39 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] group_snapshot 0db25edd-18ab-46bc-b41f-cfd03f6e104b: deleting Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] group_snapshot 0db25edd-18ab-46bc-b41f-cfd03f6e104b: deleting {{(pid=87111) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-6a348d74-5ab5-47b4-8c16-c0703a3c0de9" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-6a348d74-5ab5-47b4-8c16-c0703a3c0de9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Deleting offline snapshot 6a348d74-5ab5-47b4-8c16-c0703a3c0de9 of volume aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] snapshot_file for this snap is: volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7849fa9-37bb-4ae7-9ca6-c02d6020ea96]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:39 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.484s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[260c7356-e169-4e98-b404-a7455eb94f35]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:40 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:49:40 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:40 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 Nov 05 03:49:40 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:40 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9" returned: 0 in 0.540s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:40 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:40 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d218d7b9-54cc-4531-9feb-76e7a3438f9d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.532s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.2d5feea4-85f3-45c1-bb2a-6222139e78f9hqdka0i6.img {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:40 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.2d5feea4-85f3-45c1-bb2a-6222139e78f9hqdka0i6.img Nov 05 03:49:40 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:40 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 Nov 05 03:49:40 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:41 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" returned: 0 in 0.919s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:41 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 Nov 05 03:49:41 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:42 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9" returned: 0 in 0.710s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:42 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9 Nov 05 03:49:42 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:42 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3.6a348d74-5ab5-47b4-8c16-c0703a3c0de9" returned: 0 in 0.762s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-6a348d74-5ab5-47b4-8c16-c0703a3c0de9" released by "_delete_snapshot" :: held 3.093s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" released by "delete_snapshot" :: held 3.131s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:42 devstack cinder-volume[87111]: WARNING cinder.quota [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1354765785 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1354765785, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:49:43 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] Created reservations ['3746116b-9ecf-4967-a195-4c3769aa4058', '34a8ea73-fd24-4c5e-9f1a-8dcacd2d9e04', '9f310d9c-cebc-44a3-88fa-1d422270f980', '0feced7f-5a9d-4e29-b8ba-e584c302a61a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:43 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-17cd2fce-2ede-448b-b0e8-7465435d11c3 tempest-GroupSnapshotsTest-579333233 None] group_snapshot 0db25edd-18ab-46bc-b41f-cfd03f6e104b: deleted successfully Nov 05 03:49:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" acquired by "delete_volume" :: waited 0.049s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:44 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40cf5de-9900-47b2-95a9-e959bc0793ec]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:44 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 Nov 05 03:49:44 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:45 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" returned: 0 in 1.130s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:45 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3 Nov 05 03:49:45 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:46 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" returned: 0 in 0.718s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-aafa1ee0-0f1e-4380-9c38-eefb4a076aa3" released by "delete_volume" :: held 2.092s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Created reservations ['3156ac0b-bbab-42bb-82b2-fdd485597c29'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:46 devstack cinder-volume[87111]: WARNING cinder.db.api [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1354765785'] Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Created reservations ['81b80ca2-f3b8-4dd2-a409-7e243b3b938f', '857fb697-583d-4e9d-ae0f-c19e2aeaf850', '8e34c3ab-000a-4e86-810a-d1023d39c470', '1f348c65-6f14-4c59-b36d-59bf0747bc0c'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:46 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:49:46 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:47 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.703s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:47 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:47 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d7f31c51-c24b-49bc-98b4-0e175d785c5f tempest-GroupSnapshotsTest-579333233 None] Delete group completed successfully. Nov 05 03:49:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ef149159-2986-45e5-b9df-2d4795220649 tempest-GroupSnapshotsTest-579333233 None] Group tempest-GroupSnapshotsTest-Group-2115448385: creating Nov 05 03:49:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ef149159-2986-45e5-b9df-2d4795220649 tempest-GroupSnapshotsTest-579333233 None] Group tempest-GroupSnapshotsTest-Group-2115448385: created successfully Nov 05 03:49:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ef149159-2986-45e5-b9df-2d4795220649 tempest-GroupSnapshotsTest-579333233 None] Create group completed successfully. Nov 05 03:49:49 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.2d5feea4-85f3-45c1-bb2a-6222139e78f9hqdka0i6.img" returned: 0 in 9.133s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f02aa1d-1a78-4903-afbe-e5cc5b634ae1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:49 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:49:49 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Flow 'volume_create_manager' (e3751150-dbaa-4239-af23-c4327a89d73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:50 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b5ca80-671b-4859-90ec-45678fbe0faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.561s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70, size 1024.00 MB, duration 9.13 sec, destination /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.2d5feea4-85f3-45c1-bb2a-6222139e78f9hqdka0i6.img {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:49:50 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Converted 1024.00 MB image at 112.10 MB/s Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b5ca80-671b-4859-90ec-45678fbe0faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1849924514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2287a050-7b6d-4711-8f68-f4ad83fdd6b6,host='devstack@QuobyteHD#QuobyteHD',id=dfd91527-2800-41b1-9aea-e041294edc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7acfca222a4123a1cf39871cef7cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:50Z,use_quota=True,user_id='04fa6de67c134d2d817b5412bca41a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84349a41-f9a5-4222-b696-778bf9afdefc),volume_type_id=84349a41-f9a5-4222-b696-778bf9afdefc)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cf910-2b95-4143-94a7-301fd2c91839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cf910-2b95-4143-94a7-301fd2c91839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7279af-8c95-4ab7-9684-8217a1a6a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7279af-8c95-4ab7-9684-8217a1a6a423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd91527-2800-41b1-9aea-e041294edc67', 'volume_name': 'volume-dfd91527-2800-41b1-9aea-e041294edc67', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161001e2-ac75-40ef-a935-d62ebeba746d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161001e2-ac75-40ef-a935-d62ebeba746d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a4f56a-2971-40cf-adf5-0cf6dd319fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Volume dfd91527-2800-41b1-9aea-e041294edc67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd91527-2800-41b1-9aea-e041294edc67', 'volume_size': 1} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:50 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] 2d5feea4-85f3-45c1-bb2a-6222139e78f9 was raw, no need to convert to raw {{(pid=87111) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Flow 'volume_create_manager' (3af85892-f4e7-4ac6-bc4a-4f23843aeca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680e6f7b-3c1f-44d2-b6b2-10958f60d4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680e6f7b-3c1f-44d2-b6b2-10958f60d4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-289603630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d85386-e8d7-4fd0-865d-52f4f56a59a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932062b556d34e5d9970fa8db2ab8754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:59Z,use_quota=True,user_id='70b900a0ed1b4f688653eccad1829859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d926e66c-f28c-403b-91be-d45424b1f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d926e66c-f28c-403b-91be-d45424b1f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b511a8a-6b23-45df-8df2-d7ece6718130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b511a8a-6b23-45df-8df2-d7ece6718130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d85386-e8d7-4fd0-865d-52f4f56a59a9', 'volume_name': 'volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3ed68a-0b6e-40c2-9614-3473b15404ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3ed68a-0b6e-40c2-9614-3473b15404ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144c4136-19fb-4ca1-9310-76888405abfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Volume c9d85386-e8d7-4fd0-865d-52f4f56a59a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9', 'volume_size': 1} Nov 05 03:49:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.511s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Uploaded volume to glance image-id: 2d5feea4-85f3-45c1-bb2a-6222139e78f9. {{(pid=87111) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}} Nov 05 03:50:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 28.677s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Creating offline snapshot 0fcb3df5-7114-4b89-bcc9-431ea0c941e6 of volume c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:50:08 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-988c20b6-67bd-4b81-8ed1-6f76e9437daa tempest-VolumesActionsTest-310279607 None] Copy volume to image completed successfully. Nov 05 03:50:08 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc9c78e-98c3-47f1-9c99-565e7f4524c3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:08 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 Nov 05 03:50:08 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:09 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=42,cinder:SELECT=57,cinder:INSERT=10 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:50:09 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" returned: 0 in 0.360s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:09 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 1G Nov 05 03:50:09 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:09 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 1G" returned: 0 in 0.370s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:09 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 Nov 05 03:50:09 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:09 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6" returned: 0 in 0.330s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:09 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 is being set with open permissions: ugo+rw Nov 05 03:50:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:09 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 Nov 05 03:50:09 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:10 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6" returned: 0 in 0.245s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:10 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.info Nov 05 03:50:10 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:10 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.info" returned: 0 in 0.247s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:10 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.info is being set with open permissions: ugo+rw Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:10 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.info Nov 05 03:50:10 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=58,cinder:UPDATE=47,cinder:DELETE=2,cinder:INSERT=10 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:10 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.info" returned: 0 in 0.248s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.579s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2287a050-7b6d-4711-8f68-f4ad83fdd6b6,created_at=2026-11-05T02:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1849924514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2287a050-7b6d-4711-8f68-f4ad83fdd6b6,host='devstack@QuobyteHD#QuobyteHD',id=dfd91527-2800-41b1-9aea-e041294edc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7acfca222a4123a1cf39871cef7cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:50Z,use_quota=True,user_id='04fa6de67c134d2d817b5412bca41a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84349a41-f9a5-4222-b696-778bf9afdefc),volume_type_id=84349a41-f9a5-4222-b696-778bf9afdefc)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Creating volume dfd91527-2800-41b1-9aea-e041294edc67 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:10 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:10 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 1073741824 Nov 05 03:50:10 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5c792c77-5e45-4f0f-978d-f52e2f4261df tempest-CreateVolumesFromSnapshotTest-132045559 None] Create snapshot completed successfully Nov 05 03:50:11 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 1073741824" returned: 0 in 0.449s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:11 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 Nov 05 03:50:11 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:11 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67" returned: 0 in 0.254s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.304s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-289603630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d85386-e8d7-4fd0-865d-52f4f56a59a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932062b556d34e5d9970fa8db2ab8754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:59Z,use_quota=True,user_id='70b900a0ed1b4f688653eccad1829859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Creating volume c9d85386-e8d7-4fd0-865d-52f4f56a59a9 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:11 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:11 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 1073741824 Nov 05 03:50:11 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a4f56a-2971-40cf-adf5-0cf6dd319fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd91527-2800-41b1-9aea-e041294edc67', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cd75c7-ceea-4563-9219-dfb782b54db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:11 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Volume volume-dfd91527-2800-41b1-9aea-e041294edc67 (dfd91527-2800-41b1-9aea-e041294edc67): created successfully Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cd75c7-ceea-4563-9219-dfb782b54db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Flow 'volume_create_manager' (e3751150-dbaa-4239-af23-c4327a89d73b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d8f2da39-64d0-4213-9941-820ef497f9fb tempest-GroupSnapshotsTest-579333233 None] Created volume successfully. Nov 05 03:50:12 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 1073741824" returned: 0 in 0.501s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:12 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 Nov 05 03:50:12 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (e22af6a1-697e-42df-a093-6fcf7dab4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26759cc9-fc31-4f30-8b25-407bec8cfe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9" returned: 0 in 0.310s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.723s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26759cc9-fc31-4f30-8b25-407bec8cfe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1612542230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8db2119-50bf-4d3b-9f78-f3cceee22318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:12Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123da340-e367-43bd-ab52-93ab8067e960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123da340-e367-43bd-ab52-93ab8067e960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab815ba7-9589-4b4e-abf4-9b76de06588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab815ba7-9589-4b4e-abf4-9b76de06588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8db2119-50bf-4d3b-9f78-f3cceee22318', 'volume_name': 'volume-e8db2119-50bf-4d3b-9f78-f3cceee22318', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184d176e-2ea4-4e33-bdff-18843348f7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184d176e-2ea4-4e33-bdff-18843348f7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6496e7d-43a1-43f8-9e38-f46d2c7f37c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume e8db2119-50bf-4d3b-9f78-f3cceee22318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8db2119-50bf-4d3b-9f78-f3cceee22318', 'volume_size': 1} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0fa585-d1eb-43d7-a3d4-83baadba5b95]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144c4136-19fb-4ca1-9310-76888405abfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe03c1f-c6fb-48ac-b488-8401ca8e6e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Volume volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 (c9d85386-e8d7-4fd0-865d-52f4f56a59a9): created successfully Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe03c1f-c6fb-48ac-b488-8401ca8e6e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Flow 'volume_create_manager' (3af85892-f4e7-4ac6-bc4a-4f23843aeca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:12 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-61518eef-f154-4846-a4e9-e7be84031339 tempest-AttachVolumeNegativeTest-758846370 None] Created volume successfully. Nov 05 03:50:12 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:50:12 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (740f8fce-767d-4104-b2f2-c24b5835d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75b2b86-23d7-41d6-84cb-89331dc25ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75b2b86-23d7-41d6-84cb-89331dc25ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451451630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406883c4-9401-4d77-b27d-392a36968684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:13Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2c5359-3d63-44a6-98d4-02c498243383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2c5359-3d63-44a6-98d4-02c498243383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4679edbd-3211-4622-af12-cafdf49fff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4679edbd-3211-4622-af12-cafdf49fff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406883c4-9401-4d77-b27d-392a36968684', 'volume_name': 'volume-406883c4-9401-4d77-b27d-392a36968684', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d205a49-1546-48ac-81e4-56b0ff8ad462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d205a49-1546-48ac-81e4-56b0ff8ad462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caca3ce-8010-4ef6-9fb6-fe84bd8844e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume 406883c4-9401-4d77-b27d-392a36968684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406883c4-9401-4d77-b27d-392a36968684', 'volume_size': 1} Nov 05 03:50:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:13 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.585s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ce86a0-630e-4961-8ba1-afbf9ea2dfc2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Flow 'volume_create_manager' (4618e130-28c6-4b5e-8a7e-07e2de95f68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d2e948-ff44-4188-b21c-9cb5dc0ee5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d2e948-ff44-4188-b21c-9cb5dc0ee5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-566263514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2287a050-7b6d-4711-8f68-f4ad83fdd6b6,host='devstack@QuobyteHD#QuobyteHD',id=092ee591-fdaf-4a2f-aaf3-d8198eaa515f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7acfca222a4123a1cf39871cef7cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:13Z,use_quota=True,user_id='04fa6de67c134d2d817b5412bca41a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84349a41-f9a5-4222-b696-778bf9afdefc),volume_type_id=84349a41-f9a5-4222-b696-778bf9afdefc)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ee6c25-90c3-4285-9c5b-df8d7809fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:50:13 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ee6c25-90c3-4285-9c5b-df8d7809fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c85c3bd-11d4-44d3-ac8a-b5968846d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c85c3bd-11d4-44d3-ac8a-b5968846d93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092ee591-fdaf-4a2f-aaf3-d8198eaa515f', 'volume_name': 'volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ca7cf0-58c7-4d53-a4a2-f2b29f74fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ca7cf0-58c7-4d53-a4a2-f2b29f74fcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4234b7d8-9d6b-4d95-aefd-0e800a02f8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Volume 092ee591-fdaf-4a2f-aaf3-d8198eaa515f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f', 'volume_size': 1} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (2738959f-30dc-461c-a2d0-a54574351edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065138c6-0cec-4be2-822e-00d507e279c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065138c6-0cec-4be2-822e-00d507e279c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1095561154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1812cb-9c1a-44c8-b5fc-ed629ba5012b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:13Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db118b8c-1665-48db-b092-8c72b664e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db118b8c-1665-48db-b092-8c72b664e958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14637284-e220-446f-9594-ddbdd9854449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14637284-e220-446f-9594-ddbdd9854449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1812cb-9c1a-44c8-b5fc-ed629ba5012b', 'volume_name': 'volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afe09cd-5e6a-44aa-9ae7-f3e8bc83c30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afe09cd-5e6a-44aa-9ae7-f3e8bc83c30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e0de40-42b5-4318-b3c0-b4268c56997f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume be1812cb-9c1a-44c8-b5fc-ed629ba5012b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b', 'volume_size': 1} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:13 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.588s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:13 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img Nov 05 03:50:13 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (4474c65f-8d9a-42b7-bf89-cb83cd5121be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74d13ca-a975-405b-9fd5-1609df3dde82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74d13ca-a975-405b-9fd5-1609df3dde82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702905141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80716b48-8f03-46c5-ac32-f8017a07fa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:14Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803fb7d9-5c05-4130-a1aa-8e0f9f1807cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803fb7d9-5c05-4130-a1aa-8e0f9f1807cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ead243-63bf-4d64-8385-1c93c791dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ead243-63bf-4d64-8385-1c93c791dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80716b48-8f03-46c5-ac32-f8017a07fa60', 'volume_name': 'volume-80716b48-8f03-46c5-ac32-f8017a07fa60', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7529c468-6d35-46cc-b06e-3a4151e933c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7529c468-6d35-46cc-b06e-3a4151e933c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179b7f08-5531-486f-bef8-3f1572dfa953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume 80716b48-8f03-46c5-ac32-f8017a07fa60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80716b48-8f03-46c5-ac32-f8017a07fa60', 'volume_size': 1} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (fe96c30a-f105-4efe-be87-beb020362ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ba7c53-07fa-4dba-ac31-afec3891e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ba7c53-07fa-4dba-ac31-afec3891e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1671713799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cb3032-1bae-4ed5-95df-d4db5dcf536d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:14Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f01c7b-f205-43f1-8d26-559ce4169809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f01c7b-f205-43f1-8d26-559ce4169809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0993b0-3735-4497-b859-9569b670d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0993b0-3735-4497-b859-9569b670d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3cb3032-1bae-4ed5-95df-d4db5dcf536d', 'volume_name': 'volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545c974c-cde0-415d-99d6-99774039c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545c974c-cde0-415d-99d6-99774039c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499a3d31-eb9a-4e30-a3a0-e5d9672ab0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:14 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume f3cb3032-1bae-4ed5-95df-d4db5dcf536d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d', 'volume_size': 1} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1c17bb84-158f-4781-b62d-1ad6bf47c70c req-f64cf0a3-c402-4445-a9ce-9482cfa22a24 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:15 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:15 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:15 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.502s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:50:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:50:20 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img" returned: 0 in 6.523s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:20 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[94701146-e72a-4dcc-94eb-3d9de1924719]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:20 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:50:20 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:20 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.516s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:20 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:50:20 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Converted 1024.00 MB image at 156.96 MB/s Nov 05 03:50:20 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] 007925cb-5e69-4e35-8fda-c97db964a0f5 was raw, converting to qcow2 {{(pid=87111) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Nov 05 03:50:20 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b4cb9-561e-49de-9752-0c5e19d8e630]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:20 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img Nov 05 03:50:20 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:21 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:21 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img Nov 05 03:50:21 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:21 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img" returned: 1 in 0.310s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img /opt/stack/data/cinder/conversion/vol_upload_47gfwwah {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:21 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img /opt/stack/data/cinder/conversion/vol_upload_47gfwwah Nov 05 03:50:21 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:21 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img /opt/stack/data/cinder/conversion/vol_upload_47gfwwah" returned: 0 in 0.266s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Image conversion details: src /opt/stack/data/cinder/conversion/ba8045aa-eec9-47e4-a622-b13b2aa9bd70.temp_image.007925cb-5e69-4e35-8fda-c97db964a0f56lni2m9r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_47gfwwah {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:50:21 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c22f8-a00c-4bc9-bf18-d484d49aaa30]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_47gfwwah {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:21 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_47gfwwah Nov 05 03:50:21 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:21 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_47gfwwah" returned: 0 in 0.304s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.849s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Uploaded volume to glance image-id: 007925cb-5e69-4e35-8fda-c97db964a0f5. {{(pid=87111) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.801s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1612542230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8db2119-50bf-4d3b-9f78-f3cceee22318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:12Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Creating volume e8db2119-50bf-4d3b-9f78-f3cceee22318 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:23 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:23 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 1073741824 Nov 05 03:50:23 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:23 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b8e6cce9-b392-48c5-bb9d-d942347f7085 tempest-VolumesActionsTest-310279607 None] Copy volume to image completed successfully. Nov 05 03:50:23 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 1073741824" returned: 0 in 0.566s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:24 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 Nov 05 03:50:24 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:24 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318" returned: 0 in 0.263s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.386s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451451630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406883c4-9401-4d77-b27d-392a36968684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:13Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Creating volume 406883c4-9401-4d77-b27d-392a36968684 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:24 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6496e7d-43a1-43f8-9e38-f46d2c7f37c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8db2119-50bf-4d3b-9f78-f3cceee22318', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:24 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 1073741824 Nov 05 03:50:24 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90130c0a-64b9-4eca-8960-7b7b43e7d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 (e8db2119-50bf-4d3b-9f78-f3cceee22318): created successfully Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90130c0a-64b9-4eca-8960-7b7b43e7d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (e22af6a1-697e-42df-a093-6fcf7dab4416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5dd14921-450c-4e44-9d6d-54599f04d21a tempest-CreateVolumesFromSnapshotTest-132045559 None] Created volume successfully. Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Acquiring lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:24 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 1073741824" returned: 0 in 0.575s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Acquiring lock "cinder-quobyte-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Lock "cinder-quobyte-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:24 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 Nov 05 03:50:24 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9383b0c8-9182-4816-a64d-b60520599a02]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:25 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:50:25 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:25 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684" returned: 0 in 0.274s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.896s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2287a050-7b6d-4711-8f68-f4ad83fdd6b6,created_at=2026-11-05T02:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-566263514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2287a050-7b6d-4711-8f68-f4ad83fdd6b6,host='devstack@QuobyteHD#QuobyteHD',id=092ee591-fdaf-4a2f-aaf3-d8198eaa515f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7acfca222a4123a1cf39871cef7cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:13Z,use_quota=True,user_id='04fa6de67c134d2d817b5412bca41a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84349a41-f9a5-4222-b696-778bf9afdefc),volume_type_id=84349a41-f9a5-4222-b696-778bf9afdefc)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Creating volume 092ee591-fdaf-4a2f-aaf3-d8198eaa515f {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:25 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:25 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f 1073741824 Nov 05 03:50:25 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caca3ce-8010-4ef6-9fb6-fe84bd8844e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406883c4-9401-4d77-b27d-392a36968684', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c39182d-2cbf-49b8-9b15-64ddef2c04dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:25 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume volume-406883c4-9401-4d77-b27d-392a36968684 (406883c4-9401-4d77-b27d-392a36968684): created successfully Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c39182d-2cbf-49b8-9b15-64ddef2c04dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (740f8fce-767d-4104-b2f2-c24b5835d568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:25 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-201becb2-3492-45c6-913b-4e221b0659cd tempest-CreateVolumesFromSnapshotTest-132045559 None] Created volume successfully. Nov 05 03:50:25 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.460s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:25 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70 Nov 05 03:50:25 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:25 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" returned: 0 in 0.285s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:25 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f 1073741824" returned: 0 in 0.518s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Lock "cinder-quobyte-ba8045aa-eec9-47e4-a622-b13b2aa9bd70" released by "delete_volume" :: held 0.802s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:25 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f Nov 05 03:50:25 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Created reservations ['c1741ead-f0bd-45fd-b416-6baf30442f26', 'f1acfd84-e363-4b80-9475-b277699abd3f', '848d3a7b-2e02-4e10-9807-b7835dbf5078', 'c951b03b-45a4-42c1-adb5-4aef01d2ac9a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:25 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:25 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:26 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" returned: 0 in 0.331s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.526s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1095561154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1812cb-9c1a-44c8-b5fc-ed629ba5012b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:13Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Creating volume be1812cb-9c1a-44c8-b5fc-ed629ba5012b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:26 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4234b7d8-9d6b-4d95-aefd-0e800a02f8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96eeaaf5-9ce5-49e2-8c70-0fb7ac586ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:26 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b 1073741824 Nov 05 03:50:26 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:26 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Volume volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f (092ee591-fdaf-4a2f-aaf3-d8198eaa515f): created successfully Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96eeaaf5-9ce5-49e2-8c70-0fb7ac586ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Flow 'volume_create_manager' (4618e130-28c6-4b5e-8a7e-07e2de95f68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:26 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.315s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:26 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Deleted volume successfully. Nov 05 03:50:26 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-37d4afb5-131b-42f5-b988-ef573611fbb1 tempest-GroupSnapshotsTest-579333233 None] Created volume successfully. Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d92a0b8b-18b3-4c96-b66e-7b7701b02e39 tempest-VolumesActionsTest-310279607 None] Lock "cinder-ba8045aa-eec9-47e4-a622-b13b2aa9bd70-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:26 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b 1073741824" returned: 0 in 0.525s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:26 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b Nov 05 03:50:26 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:27 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b" returned: 0 in 0.358s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.026s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702905141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80716b48-8f03-46c5-ac32-f8017a07fa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:14Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Creating volume 80716b48-8f03-46c5-ac32-f8017a07fa60 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:27 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:27 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 1073741824 Nov 05 03:50:27 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e0de40-42b5-4318-b3c0-b4268c56997f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9861f98e-a5ef-46fe-b17f-62737a086dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:27 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b (be1812cb-9c1a-44c8-b5fc-ed629ba5012b): created successfully Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9861f98e-a5ef-46fe-b17f-62737a086dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (2738959f-30dc-461c-a2d0-a54574351edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5f7563d5-897c-470d-bbd7-8b25700db110 tempest-CreateVolumesFromSnapshotTest-132045559 None] Created volume successfully. Nov 05 03:50:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-eb8071a9-5069-41dc-bb40-fd55237169a4 tempest-GroupSnapshotsTest-579333233 None] Update group completed successfully. Nov 05 03:50:27 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 1073741824" returned: 0 in 0.521s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:27 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 Nov 05 03:50:27 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:27 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60" returned: 0 in 0.306s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.140s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1671713799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cb3032-1bae-4ed5-95df-d4db5dcf536d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff6c4805004085b5afc866d3413fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:14Z,use_quota=True,user_id='204685a253b042f3ba925e4d46d84493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Creating volume f3cb3032-1bae-4ed5-95df-d4db5dcf536d {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:27 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179b7f08-5531-486f-bef8-3f1572dfa953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80716b48-8f03-46c5-ac32-f8017a07fa60', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a22ff63-fcf8-499a-9850-d6281243df5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:27 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d 1073741824 Nov 05 03:50:27 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:28 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume volume-80716b48-8f03-46c5-ac32-f8017a07fa60 (80716b48-8f03-46c5-ac32-f8017a07fa60): created successfully Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a22ff63-fcf8-499a-9850-d6281243df5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (4474c65f-8d9a-42b7-bf89-cb83cd5121be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8f6e3169-ced6-4e5e-a909-ceb5a87f1a86 tempest-CreateVolumesFromSnapshotTest-132045559 None] Created volume successfully. Nov 05 03:50:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a2daed39-e098-42d5-b93b-a29474d19fb1 tempest-GroupSnapshotsTest-579333233 None] Update group completed successfully. Nov 05 03:50:28 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d 1073741824" returned: 0 in 0.603s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:28 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d Nov 05 03:50:28 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:28 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d" returned: 0 in 0.256s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1c17bb84-158f-4781-b62d-1ad6bf47c70c req-f64cf0a3-c402-4445-a9ce-9482cfa22a24 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499a3d31-eb9a-4e30-a3a0-e5d9672ab0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5905e0e8-9c41-46d7-96c7-f7ac6a9881e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1c17bb84-158f-4781-b62d-1ad6bf47c70c req-f64cf0a3-c402-4445-a9ce-9482cfa22a24 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:28 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Volume volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d (f3cb3032-1bae-4ed5-95df-d4db5dcf536d): created successfully Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5905e0e8-9c41-46d7-96c7-f7ac6a9881e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Flow 'volume_create_manager' (fe96c30a-f105-4efe-be87-beb020362ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-119d9498-a5fd-489b-a8b3-2195b714c6a3 tempest-CreateVolumesFromSnapshotTest-132045559 None] Created volume successfully. Nov 05 03:50:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-1c17bb84-158f-4781-b62d-1ad6bf47c70c req-f64cf0a3-c402-4445-a9ce-9482cfa22a24 tempest-AttachVolumeNegativeTest-758846370 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81d71708-5433-400d-b05d-79484bda3fe1', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:50:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-1c17bb84-158f-4781-b62d-1ad6bf47c70c req-f64cf0a3-c402-4445-a9ce-9482cfa22a24 tempest-AttachVolumeNegativeTest-758846370 None] attachment_update completed successfully. Nov 05 03:50:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-f3cb3032-1bae-4ed5-95df-d4db5dcf536d-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-f3cb3032-1bae-4ed5-95df-d4db5dcf536d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-quobyte-f3cb3032-1bae-4ed5-95df-d4db5dcf536d" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-f3cb3032-1bae-4ed5-95df-d4db5dcf536d" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-eaa14116-6485-4a28-81ac-74a3a441db8c tempest-GroupSnapshotsTest-579333233 None] Update group completed successfully. Nov 05 03:50:29 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9572a60a-b79e-489c-a815-58c1d0fd5be4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:29 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d Nov 05 03:50:29 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:30 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d" returned: 0 in 0.475s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:30 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d Nov 05 03:50:30 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:30 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f3cb3032-1bae-4ed5-95df-d4db5dcf536d" returned: 0 in 0.368s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-f3cb3032-1bae-4ed5-95df-d4db5dcf536d" released by "delete_volume" :: held 0.908s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Created reservations ['e097f3ff-f3f6-42ef-bd92-d78dc5c79212', '733f0e5a-4420-4ff7-abf7-e062af1f1cde', 'a62931df-1807-4a23-b2b2-88631ae4a1ab', '1fe9d5a6-7781-4489-8ea2-dc9ce5a54483'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:30 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:30 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2db7ff05-8aa0-4106-9aed-8e4fba9f0ad7 tempest-GroupSnapshotsTest-579333233 None] Update group completed successfully. Nov 05 03:50:31 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.368s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:31 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Deleted volume successfully. Nov 05 03:50:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42561e11-d00d-4454-863d-5e56ea0341f2 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-f3cb3032-1bae-4ed5-95df-d4db5dcf536d-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-80716b48-8f03-46c5-ac32-f8017a07fa60-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-80716b48-8f03-46c5-ac32-f8017a07fa60-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-quobyte-80716b48-8f03-46c5-ac32-f8017a07fa60" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-80716b48-8f03-46c5-ac32-f8017a07fa60" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c4e6e6-ab60-4d3c-b4b9-990ff860aa2f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:32 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 Nov 05 03:50:32 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:32 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60" returned: 0 in 0.482s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:32 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60 Nov 05 03:50:32 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] GroupSnapshot d4659ff1-2cd6-4f39-bbb0-121f741ffe57: creating. Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Group snapshot d4659ff1-2cd6-4f39-bbb0-121f741ffe57: creating. {{(pid=87111) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Creating offline snapshot 18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 of volume dfd91527-2800-41b1-9aea-e041294edc67 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4a4c17-504c-42b8-9049-f7f8aa1c784e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:32 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-80716b48-8f03-46c5-ac32-f8017a07fa60" returned: 0 in 0.337s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-80716b48-8f03-46c5-ac32-f8017a07fa60" released by "delete_volume" :: held 0.887s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:32 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Created reservations ['5c373e38-5829-43ba-b79b-65fa31dd4ce7', '79d630c2-477f-4466-97f2-811405f865d7', 'a9eeac64-1b8b-4126-ab3d-ce622c45d31f', '075bd512-517f-47cf-993d-5da50f9a4aa2'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:32 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 Nov 05 03:50:32 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:33 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:33 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-be1812cb-9c1a-44c8-b5fc-ed629ba5012b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-be1812cb-9c1a-44c8-b5fc-ed629ba5012b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-quobyte-be1812cb-9c1a-44c8-b5fc-ed629ba5012b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-be1812cb-9c1a-44c8-b5fc-ed629ba5012b" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c2ad5d-c731-45cc-922e-3016d7dcf77a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:33 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67" returned: 0 in 0.680s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:33 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 1G Nov 05 03:50:33 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:33 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.469s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:33 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Deleted volume successfully. Nov 05 03:50:33 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b Nov 05 03:50:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e85aeba6-5b59-40ea-b39e-cfcae3992e31 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-80716b48-8f03-46c5-ac32-f8017a07fa60-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:33 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:34 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b" returned: 0 in 0.563s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:34 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b Nov 05 03:50:34 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:34 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 1G" returned: 0 in 0.577s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd91527-2800-41b1-9aea-e041294edc67 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:34 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd91527-2800-41b1-9aea-e041294edc67 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 Nov 05 03:50:34 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:34 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-be1812cb-9c1a-44c8-b5fc-ed629ba5012b" returned: 0 in 0.360s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-be1812cb-9c1a-44c8-b5fc-ed629ba5012b" released by "delete_volume" :: held 0.979s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:34 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfd91527-2800-41b1-9aea-e041294edc67 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811" returned: 0 in 0.417s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:34 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:34 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Created reservations ['26f5a22e-1913-4ba0-a213-e2e8ffe75e97', '8d0b35f7-1f0d-4c45-a027-ad3b9365c14e', 'e93b4306-fc7f-4114-892f-7ffcd387a9d7', '3d9c88f1-bf9d-41ce-9922-9a6545c44e6d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:34 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:34 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:34 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:34 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811" returned: 0 in 0.442s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:34 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.354s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:35 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Deleted volume successfully. Nov 05 03:50:35 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.info Nov 05 03:50:35 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b896beeb-7127-4144-9ea7-5cc13c0302bb tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-be1812cb-9c1a-44c8-b5fc-ed629ba5012b-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:35 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.info" returned: 0 in 0.348s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:35 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:35 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.info Nov 05 03:50:35 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-406883c4-9401-4d77-b27d-392a36968684-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-406883c4-9401-4d77-b27d-392a36968684-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:35 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.info" returned: 0 in 0.380s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.965s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Creating offline snapshot 4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 of volume 092ee591-fdaf-4a2f-aaf3-d8198eaa515f {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-quobyte-406883c4-9401-4d77-b27d-392a36968684" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f43e72e-f096-41d8-95ab-3ac1798461fc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-406883c4-9401-4d77-b27d-392a36968684" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c1dbb-7707-4d92-9493-79de645a8f68]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:36 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f Nov 05 03:50:36 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:36 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 Nov 05 03:50:36 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Flow 'volume_create_manager' (3569ab04-7ac7-437d-9b6b-3718206dd218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4152d7-19ed-4682-9e0b-78c446c18859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4152d7-19ed-4682-9e0b-78c446c18859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1829351202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5226e4b4-165f-4319-a962-498f1e08861a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420044a12f30444f96ec7d5b6b1b24b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:36Z,use_quota=True,user_id='ceae4c367c8140b6b277fb38778b33d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3005d62b-a693-47fd-bbcd-47fba0840ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3005d62b-a693-47fd-bbcd-47fba0840ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6ba050-f7fb-4d23-9b63-7ed418875b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:50:36 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684" returned: 0 in 0.635s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:36 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" returned: 0 in 0.672s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:36 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684 Nov 05 03:50:36 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:36 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 1G Nov 05 03:50:36 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6ba050-f7fb-4d23-9b63-7ed418875b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5226e4b4-165f-4319-a962-498f1e08861a', 'volume_name': 'volume-5226e4b4-165f-4319-a962-498f1e08861a', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f568f86-0db4-4628-89cd-b1de279c819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f568f86-0db4-4628-89cd-b1de279c819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b828902-87ba-4d80-8c87-eb4f6f9bfbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:36 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Volume 5226e4b4-165f-4319-a962-498f1e08861a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5226e4b4-165f-4319-a962-498f1e08861a', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Trying to clone 5226e4b4-165f-4319-a962-498f1e08861a from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:50:36 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-406883c4-9401-4d77-b27d-392a36968684" returned: 0 in 0.430s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-406883c4-9401-4d77-b27d-392a36968684" released by "delete_volume" :: held 1.177s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Created reservations ['925b017c-dc37-44b8-a375-0456dae41bbf', 'ad8bcf18-605a-470b-88dc-16a53bbbbf78', 'ea35d214-91d9-4448-a9fb-8953b09d5387', 'bfed52e8-d318-4e8f-a866-05ef6d1699c7'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:37 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 1G" returned: 0 in 0.781s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:37 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 Nov 05 03:50:37 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:50:37 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:37 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:37 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ae5771-4d17-4dc0-b5d1-82292d3644ee]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:37 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD Nov 05 03:50:37 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:37 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471" returned: 0 in 0.407s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:37 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:37 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 Nov 05 03:50:37 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:37 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.379s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Deleted volume successfully. Nov 05 03:50:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90840b06-5376-498b-ac60-01cba0bb910c tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-406883c4-9401-4d77-b27d-392a36968684-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:37 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-e8db2119-50bf-4d3b-9f78-f3cceee22318-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 is fetched for user ceae4c367c8140b6b277fb38778b33d2. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-e8db2119-50bf-4d3b-9f78-f3cceee22318-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:38 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471" returned: 0 in 0.338s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:38 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.info Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-quobyte-e8db2119-50bf-4d3b-9f78-f3cceee22318" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:38 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c2a0f1-b5e6-4b56-8a91-df3978a543bd]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-e8db2119-50bf-4d3b-9f78-f3cceee22318" acquired by "delete_volume" :: waited 0.055s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1d5a38-0c5a-4e54-9912-cf4cc796360e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:38 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD Nov 05 03:50:38 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:38 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 Nov 05 03:50:38 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:38 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.info" returned: 0 in 0.400s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:38 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:38 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.info Nov 05 03:50:38 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:38 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:38 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318" returned: 0 in 0.513s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:38 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:38 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318 Nov 05 03:50:38 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.info" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.159s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1829351202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5226e4b4-165f-4319-a962-498f1e08861a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420044a12f30444f96ec7d5b6b1b24b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:36Z,use_quota=True,user_id='ceae4c367c8140b6b277fb38778b33d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Creating volume 5226e4b4-165f-4319-a962-498f1e08861a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:38 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:38 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a 1073741824 Nov 05 03:50:38 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d40d95d2-6283-4114-aead-07402f13bc4d tempest-GroupSnapshotsTest-579333233 None] group_snapshot d4659ff1-2cd6-4f39-bbb0-121f741ffe57: created successfully Nov 05 03:50:39 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e8db2119-50bf-4d3b-9f78-f3cceee22318" returned: 0 in 0.297s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-e8db2119-50bf-4d3b-9f78-f3cceee22318" released by "delete_volume" :: held 0.905s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Created reservations ['6015e733-d2f8-4095-8516-7ef188e544ed', 'd4361e93-5d7f-4ded-9d5f-403c7666ff55', 'e47482f9-d084-4597-b703-1f3e702ba029', 'ad129692-23b3-4f72-bca8-5702ab8d286e'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:39 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:39 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] group_snapshot d4659ff1-2cd6-4f39-bbb0-121f741ffe57: deleting Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] group_snapshot d4659ff1-2cd6-4f39-bbb0-121f741ffe57: deleting {{(pid=87111) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Nov 05 03:50:39 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-dfd91527-2800-41b1-9aea-e041294edc67" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a 1073741824" returned: 0 in 0.662s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-dfd91527-2800-41b1-9aea-e041294edc67" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Deleting offline snapshot 18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 of volume dfd91527-2800-41b1-9aea-e041294edc67 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] snapshot_file for this snap is: volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e68d5f7-ce53-4990-a1c3-dadf77a972f2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:39 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a Nov 05 03:50:39 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:39 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.404s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Deleted volume successfully. Nov 05 03:50:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a8828ddd-70a4-481d-a28e-42f838cf3a48 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-e8db2119-50bf-4d3b-9f78-f3cceee22318-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:39 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 Nov 05 03:50:39 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:40 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a" returned: 0 in 0.405s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Attempting download of f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume 5226e4b4-165f-4319-a962-498f1e08861a. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea12b77d-c220-4b06-a8c1-34fa8ad31fcd]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_ucvp266x {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:40 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811" returned: 0 in 0.696s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfd91527-2800-41b1-9aea-e041294edc67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-0fcb3df5-7114-4b89-bcc9-431ea0c941e6-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0539846c-272a-4f15-b96f-95f899cf884d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-0fcb3df5-7114-4b89-bcc9-431ea0c941e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-quobyte-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:40 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_ucvp266x Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-quobyte-0fcb3df5-7114-4b89-bcc9-431ea0c941e6" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:40 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-0fcb3df5-7114-4b89-bcc9-431ea0c941e6" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Deleting offline snapshot 0fcb3df5-7114-4b89-bcc9-431ea0c941e6 of volume c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] snapshot_file for this snap is: volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6361ed-89ab-417f-bf45-c7977f54adda]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:40 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 Nov 05 03:50:40 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:40 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 Nov 05 03:50:40 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:40 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_ucvp266x" returned: 0 in 0.719s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_ucvp266x {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:41 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_ucvp266x Nov 05 03:50:41 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:41 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6" returned: 0 in 0.526s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4f5dc-6473-4358-855e-0205210ca7f1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:41 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67" returned: 0 in 0.935s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:41 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 Nov 05 03:50:41 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:41 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_ucvp266x" returned: 1 in 0.619s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_ucvp266x' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e274e4b-a9ae-456b-887c-c72347c11667]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:41 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 Nov 05 03:50:41 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:41 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD Nov 05 03:50:41 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:41 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811" returned: 0 in 0.557s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:41 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" returned: 0 in 0.664s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:42 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811 Nov 05 03:50:42 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:42 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 Nov 05 03:50:42 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:42 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] f813bdfc-9ad7-4949-b238-678b8d2b8f65 was qcow2, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:42 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a Nov 05 03:50:42 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:42 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67.18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811" returned: 0 in 0.529s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-18e1ce1e-3a4b-4b73-b5ce-f5e1803d4811" released by "_delete_snapshot" :: held 2.943s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-dfd91527-2800-41b1-9aea-e041294edc67" released by "delete_snapshot" :: held 2.996s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:42 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6" returned: 0 in 0.602s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:42 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6 Nov 05 03:50:42 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-4437e1fe-1f3b-4306-abbe-9ac0a6e5c471" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-4437e1fe-1f3b-4306-abbe-9ac0a6e5c471" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Deleting offline snapshot 4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 of volume 092ee591-fdaf-4a2f-aaf3-d8198eaa515f {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] snapshot_file for this snap is: volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed1dab5-978d-47b2-8e1f-517192dc1d3c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:42 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 Nov 05 03:50:42 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:42 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1.0fcb3df5-7114-4b89-bcc9-431ea0c941e6" returned: 0 in 0.403s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-0fcb3df5-7114-4b89-bcc9-431ea0c941e6" released by "_delete_snapshot" :: held 2.447s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" released by "delete_snapshot" :: held 2.499s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Created reservations ['08cc699c-4e58-4f80-968a-25bd8fed0aa0', '64cd1aa2-b738-4195-b2cc-0543e09472e0', 'c9f2c4ba-9158-4b04-9706-bf4bf97a067c', 'b6315d94-dfbd-486d-98a7-5e85905df687'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:43 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Delete snapshot completed successfully. Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4eb58c74-a606-434a-a446-b26648a10bea tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-0fcb3df5-7114-4b89-bcc9-431ea0c941e6-delete_snapshot" released by "delete_snapshot" :: held 2.814s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:43 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471" returned: 0 in 0.729s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eadb199-8a35-42d9-916e-c859a635322c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:43 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f Nov 05 03:50:43 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "cinder-quobyte-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" acquired by "delete_volume" :: waited 0.038s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:44 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" returned: 0 in 0.636s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:44 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a038638-8b4a-43b4-8740-98ee6088756d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:44 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 Nov 05 03:50:44 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:44 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 Nov 05 03:50:44 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:45 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471" returned: 0 in 1.006s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:45 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" returned: 0 in 1.061s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:45 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471 Nov 05 03:50:45 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:45 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1 Nov 05 03:50:45 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:45 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f.4437e1fe-1f3b-4306-abbe-9ac0a6e5c471" returned: 0 in 0.650s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:45 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a" returned: 0 in 3.788s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_287hdh5adevstack@QuobyteHD, size 112.00 MB, duration 3.79 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:50:45 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Converted 112.00 MB image at 29.53 MB/s Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:45 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-4437e1fe-1f3b-4306-abbe-9ac0a6e5c471" released by "_delete_snapshot" :: held 3.238s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" returned: 0 in 0.637s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:45 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a 1G Nov 05 03:50:45 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" released by "delete_snapshot" :: held 3.307s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-quobyte-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1" released by "delete_volume" :: held 1.883s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Created reservations ['78d4da9e-c4cb-4eac-ac65-c090f1567e98', '9e11d3ed-772b-4859-a567-d56c7618fb75', '917b9d7a-c0aa-4186-896a-63e150ff4e6f', 'b64c45dc-c298-40d8-9ae8-f1a2c3901102'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:46 devstack cinder-volume[87111]: WARNING cinder.quota [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-491966294 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-491966294, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:50:46 devstack cinder-volume[87111]: WARNING cinder.quota [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-491966294 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-491966294, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Created reservations ['6af896a5-8e8f-4aff-9aff-c4db5213822f', '6b8c0322-f65e-49dd-8515-9601b4464623', '743610c7-b186-4af4-90bd-dcd71807542a', 'c91fdad1-572d-41a9-919e-5f9a1cba9393'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:46 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:46 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:46 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a 1G" returned: 0 in 0.709s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Downloaded image f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume 5226e4b4-165f-4319-a962-498f1e08861a successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 for user ceae4c367c8140b6b277fb38778b33d2 is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Marking volume 5226e4b4-165f-4319-a962-498f1e08861a as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Copying metadata from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 to 5226e4b4-165f-4319-a962-498f1e08861a. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Creating volume glance metadata for volume 5226e4b4-165f-4319-a962-498f1e08861a backed by image f813bdfc-9ad7-4949-b238-678b8d2b8f65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] Created reservations ['277b8dbf-1c1d-45b8-8036-db1c68df2e04', '964206c8-16f3-47ea-931a-8ff930bd5c4c', 'a433ec74-5a20-4a77-991d-4a6c99f4a083', 'e881efae-3a78-4a3c-9530-a67782aed12c'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:46 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.417s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Deleted volume successfully. Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-db30fe30-07a7-420c-9027-f24e86b46319 tempest-CreateVolumesFromSnapshotTest-132045559 None] Lock "cinder-c9598b0b-03ea-41b7-9ee5-1a6b2dee3ed1-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b828902-87ba-4d80-8c87-eb4f6f9bfbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5226e4b4-165f-4319-a962-498f1e08861a', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0add59bf-2086-4d30-b0e0-0e9e512f0359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b7a43933-3da5-4a7a-a907-062a77906ce0 tempest-GroupSnapshotsTest-579333233 None] group_snapshot d4659ff1-2cd6-4f39-bbb0-121f741ffe57: deleted successfully Nov 05 03:50:46 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Volume volume-5226e4b4-165f-4319-a962-498f1e08861a (5226e4b4-165f-4319-a962-498f1e08861a): created successfully Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0add59bf-2086-4d30-b0e0-0e9e512f0359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Flow 'volume_create_manager' (3569ab04-7ac7-437d-9b6b-3718206dd218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2d391f63-02a8-4267-905c-23460906c0ba tempest-VolumesExtendTest-1024838604 None] Created volume successfully. Nov 05 03:50:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e074f4c8-6a77-42b6-b734-b2d72225b8c5 tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e074f4c8-6a77-42b6-b734-b2d72225b8c5 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:47 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3856b5f0-d108-4ba2-b77e-86147f3c1497]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e074f4c8-6a77-42b6-b734-b2d72225b8c5 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:47 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a Nov 05 03:50:47 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" acquired by "delete_volume" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c15b521-2a1b-4ea9-be4b-5b280b92bcca]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:48 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f Nov 05 03:50:48 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:48 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e074f4c8-6a77-42b6-b734-b2d72225b8c5 tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a" returned: 0 in 0.590s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e074f4c8-6a77-42b6-b734-b2d72225b8c5 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a 2G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e074f4c8-6a77-42b6-b734-b2d72225b8c5 tempest-VolumesExtendTest-1024838604 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a 2G" returned: 0 in 0.150s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e074f4c8-6a77-42b6-b734-b2d72225b8c5 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.769s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e074f4c8-6a77-42b6-b734-b2d72225b8c5 tempest-VolumesExtendTest-1024838604 None] Extend volume completed successfully. Nov 05 03:50:48 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" returned: 0 in 0.604s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:48 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f Nov 05 03:50:48 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:49 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" returned: 0 in 0.358s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-092ee591-fdaf-4a2f-aaf3-d8198eaa515f" released by "delete_volume" :: held 1.062s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-dfd91527-2800-41b1-9aea-e041294edc67" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-dfd91527-2800-41b1-9aea-e041294edc67" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df95849-cf8c-4652-a1a3-1fdc93cafc98]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:49 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 Nov 05 03:50:49 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Acquiring lock "cinder-5226e4b4-165f-4319-a962-498f1e08861a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Lock "cinder-5226e4b4-165f-4319-a962-498f1e08861a-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Acquiring lock "cinder-quobyte-5226e4b4-165f-4319-a962-498f1e08861a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Lock "cinder-quobyte-5226e4b4-165f-4319-a962-498f1e08861a" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e61bf0-b015-4d83-bfee-89f825f9bff9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:49 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a Nov 05 03:50:49 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:49 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67" returned: 0 in 0.675s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:49 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67 Nov 05 03:50:49 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:50 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a" returned: 0 in 0.505s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:50 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dfd91527-2800-41b1-9aea-e041294edc67" returned: 0 in 0.372s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:50 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a Nov 05 03:50:50 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-dfd91527-2800-41b1-9aea-e041294edc67" released by "delete_volume" :: held 1.146s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Created reservations ['ac6547ca-ff23-4849-95da-d88029392f7c'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:50 devstack cinder-volume[87111]: WARNING cinder.quota [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-491966294 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-491966294, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Created reservations ['d94bcc78-9c5e-442d-b921-fbba9fcd191b', 'df203e3b-b12d-4cd3-b1a0-7ed427c9780f', '01cdbc36-bcf4-4e09-b00a-8a1b7474518b', '54c788af-0ff6-463f-8c7a-80f0d4099b37'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:50 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5226e4b4-165f-4319-a962-498f1e08861a" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Lock "cinder-quobyte-5226e4b4-165f-4319-a962-498f1e08861a" released by "delete_volume" :: held 0.859s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Created reservations ['b0fa41c9-7046-441b-9a47-3031b95bc98e', '0b72bf4c-80e8-4793-a6fb-37134b3295ca', '8f0beb98-a3e3-455e-85bb-fceba248f580', '79c77fa0-cb32-4206-8159-3f86fc37f4ff'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Created reservations ['ea6f22ee-c334-483e-a616-ff9c07fc692a', 'fe6eabbd-03be-45e5-ab0d-6eb92d9b804a', '3c602cf2-e009-45b7-b0f1-080fe01f04bc', '0bcb2c89-2f3e-4ff7-bd9a-f5ea59c0e46e'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:50 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:50 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:51 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:51 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:51 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.331s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:51 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Deleted volume successfully. Nov 05 03:50:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d20fed99-c495-46e9-b492-ba44f64f704a tempest-VolumesExtendTest-1024838604 None] Lock "cinder-5226e4b4-165f-4319-a962-498f1e08861a-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:51 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.314s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:51 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fb2d4cd8-64b4-43be-8d52-7e197b332bd5 tempest-GroupSnapshotsTest-579333233 None] Delete group completed successfully. Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Flow 'volume_create_manager' (9186fa6c-b837-49ec-9007-8b62da3497b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb197865-c5eb-4b90-ac01-916c1d59cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-044566e1-b2dd-4788-8ec4-28f8b09d7d7e tempest-GroupSnapshotsTest-579333233 None] Group tempest-GroupSnapshotsTest-Group-309531833: creating Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb197865-c5eb-4b90-ac01-916c1d59cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-871909333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f07120-0c0d-4c33-9b9e-928c978b1938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420044a12f30444f96ec7d5b6b1b24b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:53Z,use_quota=True,user_id='ceae4c367c8140b6b277fb38778b33d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a0260d-d673-45f2-b82c-5a263c248235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a0260d-d673-45f2-b82c-5a263c248235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455ebb59-7729-4f50-9643-de3d87e45a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455ebb59-7729-4f50-9643-de3d87e45a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f07120-0c0d-4c33-9b9e-928c978b1938', 'volume_name': 'volume-19f07120-0c0d-4c33-9b9e-928c978b1938', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e3438b-9b00-49fc-ab21-106d59e87ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e3438b-9b00-49fc-ab21-106d59e87ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e38c7a0-cade-4f31-bf3e-6f3c9cf24aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Volume 19f07120-0c0d-4c33-9b9e-928c978b1938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f07120-0c0d-4c33-9b9e-928c978b1938', 'volume_size': 1} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-871909333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f07120-0c0d-4c33-9b9e-928c978b1938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420044a12f30444f96ec7d5b6b1b24b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:53Z,use_quota=True,user_id='ceae4c367c8140b6b277fb38778b33d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Creating volume 19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:52 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:52 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 1073741824 Nov 05 03:50:52 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Flow 'volume_create_manager' (fd266e78-48fe-4d2f-a211-f41a4d4d54c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fd9de0-94e5-49bc-a500-c1fcc0770933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fd9de0-94e5-49bc-a500-c1fcc0770933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916374652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05122598-6733-430b-b2cb-53bd9c534c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea252af16175467aa3000c2d752cceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:53Z,use_quota=True,user_id='501ae3c5516e46049d693f0b369ec5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7eb407-b107-4a81-a7be-f95266652830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7eb407-b107-4a81-a7be-f95266652830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9940b3ce-9ecb-4cea-aa1c-06154bf0ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9940b3ce-9ecb-4cea-aa1c-06154bf0ceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05122598-6733-430b-b2cb-53bd9c534c84', 'volume_name': 'volume-05122598-6733-430b-b2cb-53bd9c534c84', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8047e84-1799-40b5-86b3-62e760b2cf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8047e84-1799-40b5-86b3-62e760b2cf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ba06e8-1775-4df9-8abd-4040a342b726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:53 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Volume 05122598-6733-430b-b2cb-53bd9c534c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05122598-6733-430b-b2cb-53bd9c534c84', 'volume_size': 1} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-044566e1-b2dd-4788-8ec4-28f8b09d7d7e tempest-GroupSnapshotsTest-579333233 None] Group tempest-GroupSnapshotsTest-Group-309531833: created successfully Nov 05 03:50:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-044566e1-b2dd-4788-8ec4-28f8b09d7d7e tempest-GroupSnapshotsTest-579333233 None] Create group completed successfully. Nov 05 03:50:53 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 1073741824" returned: 0 in 0.492s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:53 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 Nov 05 03:50:53 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:53 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938" returned: 0 in 0.344s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916374652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05122598-6733-430b-b2cb-53bd9c534c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea252af16175467aa3000c2d752cceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:53Z,use_quota=True,user_id='501ae3c5516e46049d693f0b369ec5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Creating volume 05122598-6733-430b-b2cb-53bd9c534c84 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:53 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:53 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 1073741824 Nov 05 03:50:53 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e38c7a0-cade-4f31-bf3e-6f3c9cf24aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f07120-0c0d-4c33-9b9e-928c978b1938', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a234a5c3-96b3-4db3-8b37-9155501ff29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:53 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Volume volume-19f07120-0c0d-4c33-9b9e-928c978b1938 (19f07120-0c0d-4c33-9b9e-928c978b1938): created successfully Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a234a5c3-96b3-4db3-8b37-9155501ff29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Flow 'volume_create_manager' (9186fa6c-b837-49ec-9007-8b62da3497b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-342d2ff8-6eaa-4954-af9c-6fedeea614c6 tempest-VolumesExtendTest-1024838604 None] Created volume successfully. Nov 05 03:50:54 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 1073741824" returned: 0 in 0.695s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:54 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 Nov 05 03:50:54 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Flow 'volume_create_manager' (af204290-4586-4f15-b170-2e5ebe5f7d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a45e704-b7a8-4eb0-ab77-e382d61596df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a45e704-b7a8-4eb0-ab77-e382d61596df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1597237409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc18aba1-4024-4677-ad62-fb2ee726dcfa,host='devstack@QuobyteHD#QuobyteHD',id=6717d2d5-42d8-4c7a-9bbb-3541da23e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7acfca222a4123a1cf39871cef7cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:55Z,use_quota=True,user_id='04fa6de67c134d2d817b5412bca41a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3bcdb50-bdd9-434e-b1ce-f070d3e50e94),volume_type_id=e3bcdb50-bdd9-434e-b1ce-f070d3e50e94)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3bb5ff-bb7b-47e1-ae6c-f26c75aab777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3bb5ff-bb7b-47e1-ae6c-f26c75aab777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d537d258-6943-40bf-88d9-3798cab1c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d537d258-6943-40bf-88d9-3798cab1c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6717d2d5-42d8-4c7a-9bbb-3541da23e9da', 'volume_name': 'volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7c1923-ffe9-404f-9a8a-6059ad52d81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7c1923-ffe9-404f-9a8a-6059ad52d81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63fe30b-5c5a-41eb-bf43-0834609a7fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Volume 6717d2d5-42d8-4c7a-9bbb-3541da23e9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da', 'volume_size': 1} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:54 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84" returned: 0 in 0.339s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bc18aba1-4024-4677-ad62-fb2ee726dcfa,created_at=2026-11-05T02:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1597237409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc18aba1-4024-4677-ad62-fb2ee726dcfa,host='devstack@QuobyteHD#QuobyteHD',id=6717d2d5-42d8-4c7a-9bbb-3541da23e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7acfca222a4123a1cf39871cef7cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:55Z,use_quota=True,user_id='04fa6de67c134d2d817b5412bca41a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3bcdb50-bdd9-434e-b1ce-f070d3e50e94),volume_type_id=e3bcdb50-bdd9-434e-b1ce-f070d3e50e94)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Creating volume 6717d2d5-42d8-4c7a-9bbb-3541da23e9da {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:54 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ba06e8-1775-4df9-8abd-4040a342b726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05122598-6733-430b-b2cb-53bd9c534c84', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e2724f-50b4-4389-96f2-329f03fabc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:54 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da 1073741824 Nov 05 03:50:54 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Volume volume-05122598-6733-430b-b2cb-53bd9c534c84 (05122598-6733-430b-b2cb-53bd9c534c84): created successfully Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e2724f-50b4-4389-96f2-329f03fabc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Flow 'volume_create_manager' (fd266e78-48fe-4d2f-a211-f41a4d4d54c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-47595c3e-9620-4332-8f6f-9507a3d05e80 tempest-ProjectReaderTests-1978446955 None] Created volume successfully. Nov 05 03:50:55 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da 1073741824" returned: 0 in 0.448s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:55 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da Nov 05 03:50:55 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:55 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" returned: 0 in 0.238s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.693s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63fe30b-5c5a-41eb-bf43-0834609a7fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48eef1d6-9343-4877-8ceb-4bb392835966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Creating offline snapshot 46b2155b-394c-41b4-b075-c3d50bda462d of volume 19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:50:55 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Volume volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da (6717d2d5-42d8-4c7a-9bbb-3541da23e9da): created successfully Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48eef1d6-9343-4877-8ceb-4bb392835966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Flow 'volume_create_manager' (af204290-4586-4f15-b170-2e5ebe5f7d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e7070c-d5e6-42bc-9840-b20e9eca9e25]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-96ec059a-8e30-4fb3-9b52-4d8d6262b4fd tempest-GroupSnapshotsTest-579333233 None] Created volume successfully. Nov 05 03:50:55 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 Nov 05 03:50:55 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Acquiring lock "cinder-05122598-6733-430b-b2cb-53bd9c534c84-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Lock "cinder-05122598-6733-430b-b2cb-53bd9c534c84-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:56 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938" returned: 0 in 0.405s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Acquiring lock "cinder-quobyte-05122598-6733-430b-b2cb-53bd9c534c84" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:56 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d 1G Nov 05 03:50:56 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Lock "cinder-quobyte-05122598-6733-430b-b2cb-53bd9c534c84" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f43b3e-8868-488e-a8fc-a29b49315921]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:56 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 Nov 05 03:50:56 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:56 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d 1G" returned: 0 in 0.408s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f07120-0c0d-4c33-9b9e-928c978b1938 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:56 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f07120-0c0d-4c33-9b9e-928c978b1938 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d Nov 05 03:50:56 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:56 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84" returned: 0 in 0.409s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:56 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84 Nov 05 03:50:56 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:56 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f07120-0c0d-4c33-9b9e-928c978b1938 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d" returned: 0 in 0.292s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:56 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d is being set with open permissions: ugo+rw Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:56 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d Nov 05 03:50:56 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:56 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-05122598-6733-430b-b2cb-53bd9c534c84" returned: 0 in 0.279s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Lock "cinder-quobyte-05122598-6733-430b-b2cb-53bd9c534c84" released by "delete_volume" :: held 0.740s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:56 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Created reservations ['e2de3fff-1229-4f7b-88f7-c8f16971459b', 'c6ce3938-abf2-462a-855d-3ece99592b79', '196514f1-bb15-4c19-930f-b7aaf0ec347c', '442effbb-a3d6-460d-87e2-dfe3b8e5cc39'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:57 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:50:57 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:57 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d" returned: 0 in 0.311s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] GroupSnapshot 47aae0b8-e1a8-4b07-8ecd-266eeb081bd4: creating. Nov 05 03:50:57 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.info Nov 05 03:50:57 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Group snapshot 47aae0b8-e1a8-4b07-8ecd-266eeb081bd4: creating. {{(pid=87111) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:57 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.290s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Deleted volume successfully. Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6b88125-599e-4b8f-8c02-f838a1ceab9a tempest-ProjectReaderTests-1978446955 None] Lock "cinder-05122598-6733-430b-b2cb-53bd9c534c84-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:57 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.info" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:57 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.info is being set with open permissions: ugo+rw Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:57 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.info Nov 05 03:50:57 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:57 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Flow 'volume_create_manager' (b9d26b31-3ac2-4a79-b7d1-2ae5f6240c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d93963a-eab3-42d8-95b0-522349935611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.info" returned: 0 in 0.285s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.551s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d93963a-eab3-42d8-95b0-522349935611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-827012448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c90dc77-73e1-4adf-bc15-fa62128b7c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea252af16175467aa3000c2d752cceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:58Z,use_quota=True,user_id='501ae3c5516e46049d693f0b369ec5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b5d661-3a0b-48ca-b8f5-67087593b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b5d661-3a0b-48ca-b8f5-67087593b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613269fb-c4b6-4ba1-9dba-71cfd8d309aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613269fb-c4b6-4ba1-9dba-71cfd8d309aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c90dc77-73e1-4adf-bc15-fa62128b7c13', 'volume_name': 'volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b826849d-bc6e-4122-8966-71d0c5431deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b826849d-bc6e-4122-8966-71d0c5431deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99295191-b137-4ed3-a3ab-0df52a2e05d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:57 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Volume 7c90dc77-73e1-4adf-bc15-fa62128b7c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13', 'volume_size': 1} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Creating offline snapshot 4ecea6b1-07fa-490f-b59b-d7ab5eae036f of volume 6717d2d5-42d8-4c7a-9bbb-3541da23e9da {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:50:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a0ea5884-a440-4485-a4d3-0b5a15740505 tempest-VolumesExtendTest-1024838604 None] Create snapshot completed successfully Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73dce0a-c81b-4d0d-aef7-ae9a91e289dc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:58 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da Nov 05 03:50:58 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8549a971-15bb-4bc7-b3cc-2ce759d3b863 tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:58 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" returned: 0 in 0.375s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:58 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f 1G Nov 05 03:50:58 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:58 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f 1G" returned: 0 in 0.380s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:58 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f Nov 05 03:50:58 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:58 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f" returned: 0 in 0.283s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:58 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:50:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:58 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f Nov 05 03:50:58 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:59 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f" returned: 0 in 0.226s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:59 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.info Nov 05 03:50:59 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:59 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.info" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:59 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:59 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.info Nov 05 03:50:59 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:59 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.info" returned: 0 in 0.255s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-827012448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c90dc77-73e1-4adf-bc15-fa62128b7c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea252af16175467aa3000c2d752cceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:58Z,use_quota=True,user_id='501ae3c5516e46049d693f0b369ec5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Creating volume 7c90dc77-73e1-4adf-bc15-fa62128b7c13 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:59 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:50:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:59 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 1073741824 Nov 05 03:50:59 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6fecf7e8-ee8d-4e84-a68b-00a09d7dbac8 tempest-GroupSnapshotsTest-579333233 None] group_snapshot 47aae0b8-e1a8-4b07-8ecd-266eeb081bd4: created successfully Nov 05 03:51:00 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 1073741824" returned: 0 in 0.413s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:00 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 Nov 05 03:51:00 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:00 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13" returned: 0 in 0.260s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8549a971-15bb-4bc7-b3cc-2ce759d3b863 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.293s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99295191-b137-4ed3-a3ab-0df52a2e05d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fe87e2-2e5c-4790-8e54-da27b0e37e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c34cd1-0d8c-4a04-b310-0d4adaad6a95]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8549a971-15bb-4bc7-b3cc-2ce759d3b863 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:00 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Volume volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 (7c90dc77-73e1-4adf-bc15-fa62128b7c13): created successfully Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fe87e2-2e5c-4790-8e54-da27b0e37e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Flow 'volume_create_manager' (b9d26b31-3ac2-4a79-b7d1-2ae5f6240c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:00 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6c969d21-3232-440c-b74d-51b95892998d tempest-ProjectReaderTests-1978446955 None] Created volume successfully. Nov 05 03:51:00 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] group_snapshot 47aae0b8-e1a8-4b07-8ecd-266eeb081bd4: deleting Nov 05 03:51:00 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 Nov 05 03:51:00 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] group_snapshot 47aae0b8-e1a8-4b07-8ecd-266eeb081bd4: deleting {{(pid=87111) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-4ecea6b1-07fa-490f-b59b-d7ab5eae036f" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-4ecea6b1-07fa-490f-b59b-d7ab5eae036f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Deleting offline snapshot 4ecea6b1-07fa-490f-b59b-d7ab5eae036f of volume 6717d2d5-42d8-4c7a-9bbb-3541da23e9da {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] snapshot_file for this snap is: volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec3272-2931-45ff-b380-bd74c9fa042d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:00 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f Nov 05 03:51:00 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:00 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8549a971-15bb-4bc7-b3cc-2ce759d3b863 tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938" returned: 0 in 0.469s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8549a971-15bb-4bc7-b3cc-2ce759d3b863 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d 2G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Acquiring lock "cinder-7c90dc77-73e1-4adf-bc15-fa62128b7c13-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Lock "cinder-7c90dc77-73e1-4adf-bc15-fa62128b7c13-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Acquiring lock "cinder-quobyte-7c90dc77-73e1-4adf-bc15-fa62128b7c13" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Lock "cinder-quobyte-7c90dc77-73e1-4adf-bc15-fa62128b7c13" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5246a9f8-4238-4d4f-8dbe-420af0989d75]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8549a971-15bb-4bc7-b3cc-2ce759d3b863 tempest-VolumesExtendTest-1024838604 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d 2G" returned: 0 in 0.175s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8549a971-15bb-4bc7-b3cc-2ce759d3b863 tempest-VolumesExtendTest-1024838604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.719s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:01 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f" returned: 0 in 0.446s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[43720bbb-e529-4d80-9adb-1d81330f0fcf]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8549a971-15bb-4bc7-b3cc-2ce759d3b863 tempest-VolumesExtendTest-1024838604 None] Extend volume completed successfully. Nov 05 03:51:01 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 Nov 05 03:51:01 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:01 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da Nov 05 03:51:01 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Acquiring lock "cinder-46b2155b-394c-41b4-b075-c3d50bda462d-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Lock "cinder-46b2155b-394c-41b4-b075-c3d50bda462d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Acquiring lock "cinder-quobyte-19f07120-0c0d-4c33-9b9e-928c978b1938" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Lock "cinder-quobyte-19f07120-0c0d-4c33-9b9e-928c978b1938" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Acquiring lock "cinder-quobyte-46b2155b-394c-41b4-b075-c3d50bda462d" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Lock "cinder-quobyte-46b2155b-394c-41b4-b075-c3d50bda462d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Deleting offline snapshot 46b2155b-394c-41b4-b075-c3d50bda462d of volume 19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:51:01 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] snapshot_file for this snap is: volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13" returned: 0 in 0.561s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:01 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" returned: 0 in 0.489s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed9837a-2662-422a-a4a3-3aebfa4912ad]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:01 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13 Nov 05 03:51:01 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:01 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f Nov 05 03:51:01 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:01 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d Nov 05 03:51:01 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:02 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c90dc77-73e1-4adf-bc15-fa62128b7c13" returned: 0 in 0.310s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Lock "cinder-quobyte-7c90dc77-73e1-4adf-bc15-fa62128b7c13" released by "delete_volume" :: held 0.921s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Created reservations ['e5656f8f-3434-42cf-9b85-d132b3112123', 'e0fccd8e-0b11-4f95-affb-aa7f99807c7f', 'f78e741b-4903-407f-8b58-8b19a5ea271c', '213ed7ee-bc9f-4f74-a090-718b5a61db46'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:02 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f" returned: 0 in 0.511s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:02 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:02 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:02 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d" returned: 0 in 0.566s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f07120-0c0d-4c33-9b9e-928c978b1938(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:51:02 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f Nov 05 03:51:02 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d96ac3a-f3d0-4562-a572-19a56d0de88a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:02 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 Nov 05 03:51:02 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:02 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.335s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Deleted volume successfully. Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9393a7e7-dae9-4dcf-9000-d771e7f01c6a tempest-ProjectReaderTests-1978446955 None] Lock "cinder-7c90dc77-73e1-4adf-bc15-fa62128b7c13-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:02 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da.4ecea6b1-07fa-490f-b59b-d7ab5eae036f" returned: 0 in 0.380s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-4ecea6b1-07fa-490f-b59b-d7ab5eae036f" released by "_delete_snapshot" :: held 1.984s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" released by "delete_snapshot" :: held 2.018s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:02 devstack cinder-volume[87111]: WARNING cinder.quota [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1745976139 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1745976139, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:51:02 devstack cinder-volume[87111]: WARNING cinder.quota [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1745976139 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1745976139, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] Created reservations ['4a42122e-adce-43ae-92ec-f9464e4cd14e', '392b2b54-a4ac-4f73-9035-752c4e979d7e', '0c3da585-3f1c-49d1-b8d0-98320fd281d7', '4164210f-8bc1-408c-be70-c2f89af67b1a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:02 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938" returned: 0 in 0.493s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:02 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d Nov 05 03:51:02 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a14e4971-ba45-451c-be22-57c9d6355602 tempest-GroupSnapshotsTest-579333233 None] group_snapshot 47aae0b8-e1a8-4b07-8ecd-266eeb081bd4: deleted successfully Nov 05 03:51:03 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d" returned: 0 in 0.460s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:03 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d Nov 05 03:51:03 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "cinder-quobyte-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2b7b9-d95b-4d2d-a582-bb75b10174fc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:03 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da Nov 05 03:51:03 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:03 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938.46b2155b-394c-41b4-b075-c3d50bda462d" returned: 0 in 0.466s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Lock "cinder-quobyte-46b2155b-394c-41b4-b075-c3d50bda462d" released by "_delete_snapshot" :: held 2.186s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Lock "cinder-quobyte-19f07120-0c0d-4c33-9b9e-928c978b1938" released by "delete_snapshot" :: held 2.215s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:03 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Created reservations ['c3c50cbe-9aef-4c57-b91c-55eb260dddf2', '82716955-ae76-4fa5-83c6-7d482ed23bab', 'ee20a9b4-d2d6-4f11-b2a5-7e65e1ac293b', 'afa241ab-d163-419e-abcd-f153cc09b42a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:04 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Delete snapshot completed successfully. Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" returned: 0 in 0.537s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f747a3a8-9cc6-4316-8868-acc1c28b9260 tempest-VolumesExtendTest-1024838604 None] Lock "cinder-46b2155b-394c-41b4-b075-c3d50bda462d-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:04 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da Nov 05 03:51:04 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Flow 'volume_create_manager' (5fb0a26d-5a2a-4c48-a4d6-fec59227741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2812c6-86a4-4087-97c8-3e87179b1e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2812c6-86a4-4087-97c8-3e87179b1e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561650192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5c09a2-6db5-426b-a350-cc404ad27390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea252af16175467aa3000c2d752cceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:04Z,use_quota=True,user_id='501ae3c5516e46049d693f0b369ec5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1fcbbc-7ad2-4a9f-bdee-9b5d68d90476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1fcbbc-7ad2-4a9f-bdee-9b5d68d90476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2031de4a-ae75-451e-9007-304e68996d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2031de4a-ae75-451e-9007-304e68996d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5c09a2-6db5-426b-a350-cc404ad27390', 'volume_name': 'volume-3d5c09a2-6db5-426b-a350-cc404ad27390', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10d9c3f-af65-4fcf-b5f6-d17c6d53e298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10d9c3f-af65-4fcf-b5f6-d17c6d53e298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7974ad-eb19-4d38-afb1-4d7c813c2646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Volume 3d5c09a2-6db5-426b-a350-cc404ad27390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5c09a2-6db5-426b-a350-cc404ad27390', 'volume_size': 1} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561650192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5c09a2-6db5-426b-a350-cc404ad27390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea252af16175467aa3000c2d752cceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:04Z,use_quota=True,user_id='501ae3c5516e46049d693f0b369ec5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Creating volume 3d5c09a2-6db5-426b-a350-cc404ad27390 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:04 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:04 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 1073741824 Nov 05 03:51:04 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:04 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" returned: 0 in 0.263s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Lock "cinder-quobyte-6717d2d5-42d8-4c7a-9bbb-3541da23e9da" released by "delete_volume" :: held 0.923s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Created reservations ['4d34aaab-2377-4aff-8caa-9ec6fdfd42d7'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:04 devstack cinder-volume[87111]: WARNING cinder.quota [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1745976139 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1745976139, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Created reservations ['cadab457-a526-4258-9213-7fbc72f4494c', '4ade4227-184e-4ab9-b36f-efaf06bd599f', 'b7bc803c-7e80-4f02-a2ba-650bcf01dcc2', 'ddc81ef8-67d5-438a-ad61-14d6084b273f'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:04 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:04 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:04 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 1073741824" returned: 0 in 0.486s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:04 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 Nov 05 03:51:04 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:04 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.263s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fd8c9252-c2a4-4e86-8f08-3212ef0e4eae tempest-GroupSnapshotsTest-579333233 None] Delete group completed successfully. Nov 05 03:51:04 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390" returned: 0 in 0.284s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7974ad-eb19-4d38-afb1-4d7c813c2646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5c09a2-6db5-426b-a350-cc404ad27390', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef39cf9-370b-4424-aa93-77f971c62876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:05 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Volume volume-3d5c09a2-6db5-426b-a350-cc404ad27390 (3d5c09a2-6db5-426b-a350-cc404ad27390): created successfully Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef39cf9-370b-4424-aa93-77f971c62876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Flow 'volume_create_manager' (5fb0a26d-5a2a-4c48-a4d6-fec59227741f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Acquiring lock "cinder-19f07120-0c0d-4c33-9b9e-928c978b1938-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:05 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ff427184-5e9e-4f85-b73a-a1cf96737a27 tempest-ProjectReaderTests-1978446955 None] Created volume successfully. Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Lock "cinder-19f07120-0c0d-4c33-9b9e-928c978b1938-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Acquiring lock "cinder-quobyte-19f07120-0c0d-4c33-9b9e-928c978b1938" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Lock "cinder-quobyte-19f07120-0c0d-4c33-9b9e-928c978b1938" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[819471c6-0486-4dd0-9cc1-e8e6f722e61e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:05 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 Nov 05 03:51:05 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:05 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938" returned: 0 in 0.448s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:05 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938 Nov 05 03:51:05 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:05 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-19f07120-0c0d-4c33-9b9e-928c978b1938" returned: 0 in 0.347s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Lock "cinder-quobyte-19f07120-0c0d-4c33-9b9e-928c978b1938" released by "delete_volume" :: held 0.914s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Created reservations ['68ac8fa7-3187-40dd-842b-13ad75a7220f', 'b11c0449-8d34-40ca-b197-1daea1427a90', '16c4eaae-2917-4b65-90ad-84919d45f0ca', '7e2b02d0-ec1b-42b3-908d-63cb4f2ee43d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Acquiring lock "cinder-3d5c09a2-6db5-426b-a350-cc404ad27390-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Lock "cinder-3d5c09a2-6db5-426b-a350-cc404ad27390-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.074s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:06 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:06 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Acquiring lock "cinder-quobyte-3d5c09a2-6db5-426b-a350-cc404ad27390" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Lock "cinder-quobyte-3d5c09a2-6db5-426b-a350-cc404ad27390" acquired by "delete_volume" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[318646db-3422-4ba3-a736-d4b024f5a718]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:06 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 Nov 05 03:51:06 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:06 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.497s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:06 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Deleted volume successfully. Nov 05 03:51:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ea2640e4-d13f-4e92-ac75-c9105967b4ac tempest-VolumesExtendTest-1024838604 None] Lock "cinder-19f07120-0c0d-4c33-9b9e-928c978b1938-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:07 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390" returned: 0 in 0.647s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:07 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390 Nov 05 03:51:07 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:07 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3d5c09a2-6db5-426b-a350-cc404ad27390" returned: 0 in 0.374s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Lock "cinder-quobyte-3d5c09a2-6db5-426b-a350-cc404ad27390" released by "delete_volume" :: held 1.130s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Created reservations ['7321a63a-cb9f-4bb6-8688-ea3be9a8008f', '46291ae4-35e1-496d-83e1-f0bb9aadcb2e', 'c66aabb3-a6ec-47b4-9add-66f22692b11f', 'db804888-67f5-432e-babf-8a9b526651b5'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:07 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:07 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:08 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.450s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:08 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:08 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Deleted volume successfully. Nov 05 03:51:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9e23ebc7-74bb-4078-ba7e-514646f8dd9b tempest-ProjectReaderTests-1978446955 None] Lock "cinder-3d5c09a2-6db5-426b-a350-cc404ad27390-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Flow 'volume_create_manager' (71fa87a2-b5d2-44d0-ab92-3e451e5469e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab51938-65f5-4f00-bfe1-8799c5a72aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab51938-65f5-4f00-bfe1-8799c5a72aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25909625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea252af16175467aa3000c2d752cceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:09Z,use_quota=True,user_id='501ae3c5516e46049d693f0b369ec5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988d6b63-23ce-4f11-a0f1-a6e196b87d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988d6b63-23ce-4f11-a0f1-a6e196b87d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f88b73-e8b0-41f9-aa7b-28ccfc99ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f88b73-e8b0-41f9-aa7b-28ccfc99ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7', 'volume_name': 'volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42ee82c-cd29-4bb3-843d-5a60f8ea6111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42ee82c-cd29-4bb3-843d-5a60f8ea6111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ecaa4f-f643-4658-bc4f-eb3fff6b7d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:09 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Volume 25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7', 'volume_size': 1} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25909625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea252af16175467aa3000c2d752cceaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:09Z,use_quota=True,user_id='501ae3c5516e46049d693f0b369ec5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Creating volume 25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:09 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:51:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:09 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 1073741824 Nov 05 03:51:09 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:10 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 1073741824" returned: 0 in 0.707s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=204,cinder:UPDATE=227,cinder:INSERT=51,cinder:DELETE=10 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:10 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 Nov 05 03:51:10 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:10 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7" returned: 0 in 0.275s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ecaa4f-f643-4658-bc4f-eb3fff6b7d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5fa488-da27-452c-94ef-fd7523f397bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:10 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Volume volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 (25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7): created successfully Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5fa488-da27-452c-94ef-fd7523f397bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Flow 'volume_create_manager' (71fa87a2-b5d2-44d0-ab92-3e451e5469e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ce2cdf17-b42b-4d84-bb5b-2372fef0762e tempest-ProjectReaderTests-1978446955 None] Created volume successfully. Nov 05 03:51:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Acquiring lock "cinder-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Lock "cinder-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:11 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=199,cinder:UPDATE=214,cinder:DELETE=18,cinder:INSERT=64 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:51:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Acquiring lock "cinder-quobyte-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Lock "cinder-quobyte-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7" acquired by "delete_volume" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede1503c-15ba-473e-b12e-82af8448d13a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:11 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 Nov 05 03:51:11 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:12 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7" returned: 0 in 0.482s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:12 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7 Nov 05 03:51:12 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:12 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7" returned: 0 in 0.318s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Lock "cinder-quobyte-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7" released by "delete_volume" :: held 0.879s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Created reservations ['89264c52-1227-4019-a0ad-760c2da2f941', 'be505aa7-018f-42df-8ff0-7c87f21e9023', '0d407793-b754-4c25-bad2-cb025f05ca5d', '2de4626e-43f4-4441-85dd-129b95926773'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:12 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:12 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:12 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-b52846c3-2621-4bb1-a29b-a8a5025437a6 req-a64f612b-682e-492a-b789-a3b5ad16afa2 tempest-AttachVolumeNegativeTest-758846370 None] Terminate volume connection completed successfully. Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-b52846c3-2621-4bb1-a29b-a8a5025437a6 req-a64f612b-682e-492a-b789-a3b5ad16afa2 tempest-AttachVolumeNegativeTest-758846370 None] Deleting attachment 81d71708-5433-400d-b05d-79484bda3fe1. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:51:12 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.406s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:12 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Deleted volume successfully. Nov 05 03:51:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-521dbe03-1ea1-4986-80c8-d24ee2106962 tempest-ProjectReaderTests-1978446955 None] Lock "cinder-25f6a0c4-bb84-461e-ad3c-52a7c0fb5fb7-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:15 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:15 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:15 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.358s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:51:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:51:18 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Flow 'volume_create_manager' (7e074d53-509e-48b6-9749-f562d8ad06f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcb0b83-9705-481f-bc3e-1cd2d0fb6632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcb0b83-9705-481f-bc3e-1cd2d0fb6632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1595488772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1626eb0-8ac5-4cd5-b11d-4e7af18077df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6851a88b2e4bffb495e97124565380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:19Z,use_quota=True,user_id='f49e99c603eb4a74a44e33314048f8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0fe1d7-f581-450f-8c43-ed42a7153ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0fe1d7-f581-450f-8c43-ed42a7153ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8250769-1cac-4ab5-9dc1-2cd08c9687f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8250769-1cac-4ab5-9dc1-2cd08c9687f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1626eb0-8ac5-4cd5-b11d-4e7af18077df', 'volume_name': 'volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badc5edc-8215-4821-b2d7-f81aa22d6651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badc5edc-8215-4821-b2d7-f81aa22d6651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101cd8ca-db29-47fe-a133-aa1190577f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:19 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Volume f1626eb0-8ac5-4cd5-b11d-4e7af18077df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df', 'volume_size': 1} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1595488772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1626eb0-8ac5-4cd5-b11d-4e7af18077df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6851a88b2e4bffb495e97124565380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:19Z,use_quota=True,user_id='f49e99c603eb4a74a44e33314048f8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Creating volume f1626eb0-8ac5-4cd5-b11d-4e7af18077df {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:19 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:19 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df 1073741824 Nov 05 03:51:19 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:19 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df 1073741824" returned: 0 in 0.558s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:19 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df Nov 05 03:51:19 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:20 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df" returned: 0 in 0.313s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101cd8ca-db29-47fe-a133-aa1190577f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc9a6c2-fe19-46af-a4c7-031c03b6a12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Volume volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df (f1626eb0-8ac5-4cd5-b11d-4e7af18077df): created successfully Nov 05 03:51:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc9a6c2-fe19-46af-a4c7-031c03b6a12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Flow 'volume_create_manager' (7e074d53-509e-48b6-9749-f562d8ad06f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b557cce0-367d-4884-b327-12bb9cafb93d tempest-VolumesNegativeTest-324492893 None] Created volume successfully. Nov 05 03:51:23 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-da05c1de-0d2e-450c-8c07-2eb36e8c0e19 tempest-GroupsV314Test-2135380362 None] Group tempest-GroupsV314Test-Group-1470838890: creating Nov 05 03:51:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-da05c1de-0d2e-450c-8c07-2eb36e8c0e19 tempest-GroupsV314Test-2135380362 None] Group tempest-GroupsV314Test-Group-1470838890: created successfully Nov 05 03:51:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-da05c1de-0d2e-450c-8c07-2eb36e8c0e19 tempest-GroupsV314Test-2135380362 None] Create group completed successfully. Nov 05 03:51:25 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Flow 'volume_create_manager' (f07532ba-da18-4060-aacf-70ea4e66396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ffe21c-4750-473f-9838-94b26727e627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ffe21c-4750-473f-9838-94b26727e627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-501286470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15663b49-6085-478a-868f-dbe648eab26a,host='devstack@QuobyteHD#QuobyteHD',id=f354def9-7e82-430d-ad1d-5435dc36f032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a2479de139402d90048045033cf289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:26Z,use_quota=True,user_id='159503736baf42658dd3c3cd7330cc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e14ac11-7cf1-4202-9db7-4ae9a0d8b4e9),volume_type_id=3e14ac11-7cf1-4202-9db7-4ae9a0d8b4e9)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22128b7e-222f-4308-86d5-8c66d1e7aea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22128b7e-222f-4308-86d5-8c66d1e7aea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabc0145-1148-4f0e-bd34-22337feecd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabc0145-1148-4f0e-bd34-22337feecd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f354def9-7e82-430d-ad1d-5435dc36f032', 'volume_name': 'volume-f354def9-7e82-430d-ad1d-5435dc36f032', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccce799-841c-4a08-8d1e-f81d824f6230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccce799-841c-4a08-8d1e-f81d824f6230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190637ec-6b5b-4467-a0c8-2d7ccf841605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:26 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Volume f354def9-7e82-430d-ad1d-5435dc36f032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f354def9-7e82-430d-ad1d-5435dc36f032', 'volume_size': 1} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15663b49-6085-478a-868f-dbe648eab26a,created_at=2026-11-05T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-501286470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15663b49-6085-478a-868f-dbe648eab26a,host='devstack@QuobyteHD#QuobyteHD',id=f354def9-7e82-430d-ad1d-5435dc36f032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a2479de139402d90048045033cf289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:26Z,use_quota=True,user_id='159503736baf42658dd3c3cd7330cc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e14ac11-7cf1-4202-9db7-4ae9a0d8b4e9),volume_type_id=3e14ac11-7cf1-4202-9db7-4ae9a0d8b4e9)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Creating volume f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:26 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:26 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 1073741824 Nov 05 03:51:26 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:26 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 1073741824" returned: 0 in 0.567s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:26 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 Nov 05 03:51:26 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:27 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032" returned: 0 in 0.307s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190637ec-6b5b-4467-a0c8-2d7ccf841605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f354def9-7e82-430d-ad1d-5435dc36f032', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cefd23-2d67-4ac7-a5d7-833d7c462d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:27 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Volume volume-f354def9-7e82-430d-ad1d-5435dc36f032 (f354def9-7e82-430d-ad1d-5435dc36f032): created successfully Nov 05 03:51:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cefd23-2d67-4ac7-a5d7-833d7c462d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Flow 'volume_create_manager' (f07532ba-da18-4060-aacf-70ea4e66396e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ac29da88-19e2-477e-b7d5-a347aa8aaa78 tempest-GroupsV314Test-2135380362 None] Created volume successfully. Nov 05 03:51:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:28 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Cloning volume f354def9-7e82-430d-ad1d-5435dc36f032 to volume fe1f0f76-6684-455b-9155-d96f8076ab86 Nov 05 03:51:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Creating offline snapshot 6764be8d-24da-4d06-84b7-b35422015d5b of volume f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:51:28 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d153a62a-8fc5-45f0-8c78-2a8c0d0ac69d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:28 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 Nov 05 03:51:28 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:29 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032" returned: 0 in 0.882s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:29 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b 1G Nov 05 03:51:29 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:29 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b 1G" returned: 0 in 0.577s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f354def9-7e82-430d-ad1d-5435dc36f032 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:29 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f354def9-7e82-430d-ad1d-5435dc36f032 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b Nov 05 03:51:29 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:30 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f354def9-7e82-430d-ad1d-5435dc36f032 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b" returned: 0 in 0.653s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:30 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:51:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:30 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b Nov 05 03:51:30 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:31 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b" returned: 0 in 0.578s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:31 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.info Nov 05 03:51:31 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:31 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.info" returned: 0 in 0.376s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:31 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:31 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.info Nov 05 03:51:31 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:31 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.info" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Acquiring lock "cinder-quobyte-fe1f0f76-6684-455b-9155-d96f8076ab86" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Lock "cinder-quobyte-fe1f0f76-6684-455b-9155-d96f8076ab86" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] snapshot: 6764be8d-24da-4d06-84b7-b35422015d5b, volume: fe1f0f76-6684-455b-9155-d96f8076ab86, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:32 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af0d204-e0cc-421f-a2cf-e33d5a854f89]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:32 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b Nov 05 03:51:32 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:32 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b" returned: 0 in 0.597s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f354def9-7e82-430d-ad1d-5435dc36f032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:51:32 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4b6ef4-1abf-4123-95b7-95753d66bce8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:32 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 Nov 05 03:51:32 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:33 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032" returned: 0 in 0.730s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:51:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:51:33 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:51:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:33 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 Nov 05 03:51:33 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:41 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:51:41 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=19,cinder:DELETE=3,cinder:SELECT=20,cinder:INSERT=4 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:51:43 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86" returned: 0 in 10.189s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:43 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032, size 1024.00 MB, duration 10.19 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:51:43 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Converted 1024.00 MB image at 100.49 MB/s Nov 05 03:51:43 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:51:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:43 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 Nov 05 03:51:43 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:43 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86" returned: 0 in 0.342s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Lock "cinder-quobyte-fe1f0f76-6684-455b-9155-d96f8076ab86" released by "_copy_volume_from_snapshot" :: held 11.994s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Acquiring lock "cinder-quobyte-6764be8d-24da-4d06-84b7-b35422015d5b" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Lock "cinder-quobyte-6764be8d-24da-4d06-84b7-b35422015d5b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Deleting offline snapshot 6764be8d-24da-4d06-84b7-b35422015d5b of volume f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:51:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] snapshot_file for this snap is: volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:51:44 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[505edaeb-3004-4c4d-be23-b35a9243add8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:44 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b Nov 05 03:51:44 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:44 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b" returned: 0 in 0.588s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f354def9-7e82-430d-ad1d-5435dc36f032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:51:44 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba9a0d9-cc17-4dc1-a6cc-972c38779835]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:44 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 Nov 05 03:51:44 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:45 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032" returned: 0 in 0.670s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:45 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b Nov 05 03:51:45 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:45 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b" returned: 0 in 0.480s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:45 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b Nov 05 03:51:45 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:46 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032.6764be8d-24da-4d06-84b7-b35422015d5b" returned: 0 in 0.258s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Lock "cinder-quobyte-6764be8d-24da-4d06-84b7-b35422015d5b" released by "_delete_snapshot" :: held 2.134s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.991s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-dd889f71-dcbf-4e52-845d-3556afbd3f76 tempest-GroupsV314Test-2135380362 None] Create group from source-group-15663b49-6085-478a-868f-dbe648eab26a completed successfully. Nov 05 03:51:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Acquiring lock "cinder-quobyte-fe1f0f76-6684-455b-9155-d96f8076ab86" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Lock "cinder-quobyte-fe1f0f76-6684-455b-9155-d96f8076ab86" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:47 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3423b8-e3fd-4e40-997e-25045f5a3983]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:47 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 Nov 05 03:51:47 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:47 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86" returned: 0 in 0.418s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:47 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86 Nov 05 03:51:47 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:47 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fe1f0f76-6684-455b-9155-d96f8076ab86" returned: 0 in 0.303s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Lock "cinder-quobyte-fe1f0f76-6684-455b-9155-d96f8076ab86" released by "delete_volume" :: held 0.781s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Created reservations ['892eaaa5-0efc-4ba4-b26c-fc2d9cf6e4b6'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:48 devstack cinder-volume[87111]: WARNING cinder.quota [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2101040317 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2101040317, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:51:48 devstack cinder-volume[87111]: WARNING cinder.quota [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2101040317 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2101040317, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Created reservations ['982abcd8-3446-4e74-b724-927d81ef9e0a', '0b6ede99-926b-4384-a886-ca3501d092b5', 'ea3f33d6-f5f8-420f-8f48-10a8e2176c80', '1697feaa-b891-4fb3-b730-0b23e11fc511'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:48 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:48 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:48 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.303s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-13d5b28e-1ba4-4e2e-b5ec-e55072d18510 tempest-GroupsV314Test-2135380362 None] Delete group completed successfully. Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Acquiring lock "cinder-quobyte-f354def9-7e82-430d-ad1d-5435dc36f032" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Lock "cinder-quobyte-f354def9-7e82-430d-ad1d-5435dc36f032" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc389e9-eda4-4e7f-8cd5-ae90f2b0eed9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:48 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 Nov 05 03:51:48 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Acquiring lock "cinder-f1626eb0-8ac5-4cd5-b11d-4e7af18077df-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Lock "cinder-f1626eb0-8ac5-4cd5-b11d-4e7af18077df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:49 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032" returned: 0 in 0.421s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:49 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032 Nov 05 03:51:49 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Acquiring lock "cinder-quobyte-f1626eb0-8ac5-4cd5-b11d-4e7af18077df" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Lock "cinder-quobyte-f1626eb0-8ac5-4cd5-b11d-4e7af18077df" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[632d7c76-422b-418f-b68e-41094aca418f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:49 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df Nov 05 03:51:49 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:49 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f354def9-7e82-430d-ad1d-5435dc36f032" returned: 0 in 0.292s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Lock "cinder-quobyte-f354def9-7e82-430d-ad1d-5435dc36f032" released by "delete_volume" :: held 0.813s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Created reservations ['fca273c1-e94c-42b4-890b-4426ece76b7e'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Created reservations ['665c72a4-71e6-4970-be0e-1c80ce8d42fd', '8aeedd3d-e664-4ab2-b06f-dce43a22ba73', 'd0dbc278-da25-488b-b55d-1b352c807196', '64f1f115-4a68-48a1-a4e2-0ed4899f62cb'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:49 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df" returned: 0 in 0.404s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:49 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df Nov 05 03:51:49 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:49 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:49 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:50 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1626eb0-8ac5-4cd5-b11d-4e7af18077df" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Lock "cinder-quobyte-f1626eb0-8ac5-4cd5-b11d-4e7af18077df" released by "delete_volume" :: held 0.757s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:50 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.317s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f74bf9d8-7f9e-4c83-9cd7-0e30ef9f291f tempest-GroupsV314Test-2135380362 None] Delete group completed successfully. Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Created reservations ['3d1e2bc3-e7e1-4bff-867f-816b9c8d42f5', 'da8ac1c9-654c-40eb-bd79-97dd899e92b4', 'a13bad21-5b80-46f3-839d-7e5d23349f3f', 'bcac0fd9-4854-455a-a147-c05f130aba98'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:50 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:51:50 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:50 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.286s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Deleted volume successfully. Nov 05 03:51:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5c50d81b-f7cd-47f3-8321-7367d6839451 tempest-VolumesNegativeTest-324492893 None] Lock "cinder-f1626eb0-8ac5-4cd5-b11d-4e7af18077df-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Flow 'volume_create_manager' (682d0d7f-41fa-48a3-93e5-b63c3a7d09e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94d0167-4dc1-432e-a0b2-e0915d32b30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94d0167-4dc1-432e-a0b2-e0915d32b30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1084330254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c146c419-5128-4d2e-b9fa-33e07887d803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932062b556d34e5d9970fa8db2ab8754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:58Z,use_quota=True,user_id='70b900a0ed1b4f688653eccad1829859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b25daa-a612-40c9-aac4-b152ebd7c3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b25daa-a612-40c9-aac4-b152ebd7c3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a191884e-9283-414b-8093-3dbeb73db7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a191884e-9283-414b-8093-3dbeb73db7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c146c419-5128-4d2e-b9fa-33e07887d803', 'volume_name': 'volume-c146c419-5128-4d2e-b9fa-33e07887d803', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1097be0d-7338-4300-bb01-5d399c169239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1097be0d-7338-4300-bb01-5d399c169239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac52ec1-47b1-40d4-b5e5-176f029c3767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Volume c146c419-5128-4d2e-b9fa-33e07887d803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c146c419-5128-4d2e-b9fa-33e07887d803', 'volume_size': 1} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1084330254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c146c419-5128-4d2e-b9fa-33e07887d803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932062b556d34e5d9970fa8db2ab8754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:58Z,use_quota=True,user_id='70b900a0ed1b4f688653eccad1829859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Creating volume c146c419-5128-4d2e-b9fa-33e07887d803 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:58 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:51:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:58 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 1073741824 Nov 05 03:51:58 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:59 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 1073741824" returned: 0 in 0.684s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:59 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 Nov 05 03:51:59 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:59 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803" returned: 0 in 0.315s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac52ec1-47b1-40d4-b5e5-176f029c3767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c146c419-5128-4d2e-b9fa-33e07887d803', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1bc58c-2fb4-4df8-9fc1-b65679c6d205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Volume volume-c146c419-5128-4d2e-b9fa-33e07887d803 (c146c419-5128-4d2e-b9fa-33e07887d803): created successfully Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1bc58c-2fb4-4df8-9fc1-b65679c6d205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Flow 'volume_create_manager' (682d0d7f-41fa-48a3-93e5-b63c3a7d09e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-07f107cc-cfe3-44c1-b931-325002c5f975 tempest-AttachVolumeNegativeTest-758846370 None] Created volume successfully. Nov 05 03:52:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-fff40a0d-0dd7-49ad-88c0-9b49b47c4c06 req-500ddcaf-6737-47d5-a266-5d3a826db56a tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-fff40a0d-0dd7-49ad-88c0-9b49b47c4c06 req-500ddcaf-6737-47d5-a266-5d3a826db56a tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-fff40a0d-0dd7-49ad-88c0-9b49b47c4c06 req-500ddcaf-6737-47d5-a266-5d3a826db56a tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-fff40a0d-0dd7-49ad-88c0-9b49b47c4c06 req-500ddcaf-6737-47d5-a266-5d3a826db56a tempest-AttachVolumeNegativeTest-758846370 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-c146c419-5128-4d2e-b9fa-33e07887d803', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd55a7dfd-c7a3-4bbc-9327-29d6e5f8ce60', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:52:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-fff40a0d-0dd7-49ad-88c0-9b49b47c4c06 req-500ddcaf-6737-47d5-a266-5d3a826db56a tempest-AttachVolumeNegativeTest-758846370 None] attachment_update completed successfully. Nov 05 03:52:05 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-e87c9b53-612c-4644-9c84-ec0c13bde222 req-bede0028-3e13-4005-b8f3-6907feaaf467 tempest-AttachVolumeNegativeTest-758846370 None] Terminate volume connection completed successfully. Nov 05 03:52:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-e87c9b53-612c-4644-9c84-ec0c13bde222 req-bede0028-3e13-4005-b8f3-6907feaaf467 tempest-AttachVolumeNegativeTest-758846370 None] Deleting attachment d55a7dfd-c7a3-4bbc-9327-29d6e5f8ce60. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (5624d401-55c8-48ea-9d1b-9c4fcac235bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fe7ee8-7145-4c92-9f08-702f819c0913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fe7ee8-7145-4c92-9f08-702f819c0913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-715998795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c906dc-baad-4162-8df8-50e95c54c714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f1270dfd44b94b0c42f7207275006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:10Z,use_quota=True,user_id='8b970043d0d049208d27c2d8b427a1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9a58f1-74f0-423d-af80-93b9f3fb11a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9a58f1-74f0-423d-af80-93b9f3fb11a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914e11e7-895b-4032-9534-ad30cea9f53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914e11e7-895b-4032-9534-ad30cea9f53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c906dc-baad-4162-8df8-50e95c54c714', 'volume_name': 'volume-46c906dc-baad-4162-8df8-50e95c54c714', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06196c02-0a0f-4b99-9cd4-281456af4fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06196c02-0a0f-4b99-9cd4-281456af4fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9447f0-af38-4524-9043-14325df2f213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:10 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume 46c906dc-baad-4162-8df8-50e95c54c714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c906dc-baad-4162-8df8-50e95c54c714', 'volume_size': 1} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-715998795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c906dc-baad-4162-8df8-50e95c54c714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f1270dfd44b94b0c42f7207275006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:10Z,use_quota=True,user_id='8b970043d0d049208d27c2d8b427a1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Creating volume 46c906dc-baad-4162-8df8-50e95c54c714 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:10 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:10 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 1073741824 Nov 05 03:52:10 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:10 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 1073741824" returned: 0 in 0.484s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:10 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 Nov 05 03:52:10 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:11 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714" returned: 0 in 0.370s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9447f0-af38-4524-9043-14325df2f213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c906dc-baad-4162-8df8-50e95c54c714', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadb2e6f-bda5-4d65-bc61-ae9c1be37dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:11 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume volume-46c906dc-baad-4162-8df8-50e95c54c714 (46c906dc-baad-4162-8df8-50e95c54c714): created successfully Nov 05 03:52:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadb2e6f-bda5-4d65-bc61-ae9c1be37dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (5624d401-55c8-48ea-9d1b-9c4fcac235bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8f88d0d5-8858-44ff-8d84-55a7b4559af3 tempest-VolumesSnapshotTestJSON-1752262491 None] Created volume successfully. Nov 05 03:52:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Creating offline snapshot 15181990-e4c9-4f68-a551-277c62b9f666 of volume 46c906dc-baad-4162-8df8-50e95c54c714 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:52:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[448abcb1-654a-476e-a5a4-f97b1f287275]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:13 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 Nov 05 03:52:13 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:13 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714" returned: 0 in 0.453s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:13 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 1G Nov 05 03:52:13 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:13 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 1G" returned: 0 in 0.518s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c906dc-baad-4162-8df8-50e95c54c714 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:14 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c906dc-baad-4162-8df8-50e95c54c714 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 Nov 05 03:52:14 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:14 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c906dc-baad-4162-8df8-50e95c54c714 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666" returned: 0 in 0.349s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:14 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 is being set with open permissions: ugo+rw Nov 05 03:52:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:14 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 Nov 05 03:52:14 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:14 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666" returned: 0 in 0.310s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:14 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.info Nov 05 03:52:14 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:14 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.info" returned: 0 in 0.274s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:14 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.info is being set with open permissions: ugo+rw Nov 05 03:52:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:14 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.info Nov 05 03:52:14 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:15 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.info" returned: 0 in 0.331s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:15 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:52:15 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7a036a41-9d68-468f-9981-526d044304b9 tempest-VolumesSnapshotTestJSON-1752262491 None] Create snapshot completed successfully Nov 05 03:52:15 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.369s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:52:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-15181990-e4c9-4f68-a551-277c62b9f666-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-15181990-e4c9-4f68-a551-277c62b9f666-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-46c906dc-baad-4162-8df8-50e95c54c714" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-46c906dc-baad-4162-8df8-50e95c54c714" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-15181990-e4c9-4f68-a551-277c62b9f666" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-15181990-e4c9-4f68-a551-277c62b9f666" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Deleting offline snapshot 15181990-e4c9-4f68-a551-277c62b9f666 of volume 46c906dc-baad-4162-8df8-50e95c54c714 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] snapshot_file for this snap is: volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe16e7a0-6dde-448e-be31-c034834ab7d8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:16 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 Nov 05 03:52:16 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:17 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666" returned: 0 in 0.675s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c906dc-baad-4162-8df8-50e95c54c714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:52:17 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e82ce6c-edd8-45ae-b2e0-2b816cb31500]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:17 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 Nov 05 03:52:17 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:17 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714" returned: 0 in 0.503s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:17 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 Nov 05 03:52:17 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:18 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666" returned: 0 in 0.506s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:18 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666 Nov 05 03:52:18 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:18 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714.15181990-e4c9-4f68-a551-277c62b9f666" returned: 0 in 0.348s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-15181990-e4c9-4f68-a551-277c62b9f666" released by "_delete_snapshot" :: held 2.167s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-46c906dc-baad-4162-8df8-50e95c54c714" released by "delete_snapshot" :: held 2.196s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:18 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Created reservations ['7c07f89b-a79c-4682-a23c-159cc9c1be70', '3e411ae1-0a5a-47ea-bbcd-5b59e9cdccf4', 'fa716aa1-2b39-4b2f-afe2-ffb47d62b87d', 'd690a9b2-8e0b-4d65-9d5e-5d319f692b80'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Delete snapshot completed successfully. Nov 05 03:52:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72f4e7e7-cdc1-4c6d-b005-f854099ea90f tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-15181990-e4c9-4f68-a551-277c62b9f666-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (621d74c1-cb5d-4e10-bcfd-a933b7e231d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36da6ac7-f475-4985-95f6-6ca460376bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36da6ac7-f475-4985-95f6-6ca460376bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1473533248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e05de4-14da-4e24-afdf-546ad69f6a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f1270dfd44b94b0c42f7207275006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:20Z,use_quota=True,user_id='8b970043d0d049208d27c2d8b427a1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101c839b-d835-45e1-b87c-75c41c5eabe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101c839b-d835-45e1-b87c-75c41c5eabe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2c5e47-a113-4402-b53f-484b2887ee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2c5e47-a113-4402-b53f-484b2887ee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e05de4-14da-4e24-afdf-546ad69f6a8a', 'volume_name': 'volume-26e05de4-14da-4e24-afdf-546ad69f6a8a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9852ec-1d00-436b-8a9f-3905351b1b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9852ec-1d00-436b-8a9f-3905351b1b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035dc76e-df24-40e2-92b0-60b67b3ed508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Volume 26e05de4-14da-4e24-afdf-546ad69f6a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e05de4-14da-4e24-afdf-546ad69f6a8a', 'volume_size': 1} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1473533248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e05de4-14da-4e24-afdf-546ad69f6a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f1270dfd44b94b0c42f7207275006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:20Z,use_quota=True,user_id='8b970043d0d049208d27c2d8b427a1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Creating volume 26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:20 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:52:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:20 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a 1073741824 Nov 05 03:52:20 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:21 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a 1073741824" returned: 0 in 0.556s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:21 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a Nov 05 03:52:21 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:21 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035dc76e-df24-40e2-92b0-60b67b3ed508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e05de4-14da-4e24-afdf-546ad69f6a8a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8092dbe4-d52a-49a1-a264-78dc02c9feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:21 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Volume volume-26e05de4-14da-4e24-afdf-546ad69f6a8a (26e05de4-14da-4e24-afdf-546ad69f6a8a): created successfully Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8092dbe4-d52a-49a1-a264-78dc02c9feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (621d74c1-cb5d-4e10-bcfd-a933b7e231d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:21 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d08bcb63-ddba-49b9-a23e-ed9685822e7c tempest-VolumesSnapshotTestJSON-1752262491 None] Created volume successfully. Nov 05 03:52:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Creating offline snapshot 24621a68-a574-4fcd-9585-5f4666242b39 of volume 26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:52:22 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5734237a-9a96-4ca6-8f28-17aa0e75fcc2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:22 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a Nov 05 03:52:22 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:23 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a" returned: 0 in 0.444s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:23 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 1G Nov 05 03:52:23 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:23 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 1G" returned: 0 in 0.652s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e05de4-14da-4e24-afdf-546ad69f6a8a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:23 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e05de4-14da-4e24-afdf-546ad69f6a8a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 Nov 05 03:52:23 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:24 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e05de4-14da-4e24-afdf-546ad69f6a8a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39" returned: 0 in 0.421s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:24 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 is being set with open permissions: ugo+rw Nov 05 03:52:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:24 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 Nov 05 03:52:24 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:24 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39" returned: 0 in 0.280s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:24 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.info Nov 05 03:52:24 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:25 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.info" returned: 0 in 0.557s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:25 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.info is being set with open permissions: ugo+rw Nov 05 03:52:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:25 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.info Nov 05 03:52:25 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:25 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.info" returned: 0 in 0.570s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.107s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:25 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5f01c95b-68f5-4034-bbd5-c3ee35624bb9 tempest-VolumesSnapshotTestJSON-1752262491 None] Create snapshot completed successfully Nov 05 03:52:27 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (87f27591-df70-41f5-b8a4-c612b8f7ab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6405461e-ab74-4f6b-96b5-bb5ce052655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6405461e-ab74-4f6b-96b5-bb5ce052655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1373725723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9690bd-0264-4306-9323-0e0f3c94529c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f1270dfd44b94b0c42f7207275006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=24621a68-a574-4fcd-9585-5f4666242b39,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:28Z,use_quota=True,user_id='8b970043d0d049208d27c2d8b427a1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c50a0f-e253-4843-96ee-771763d96eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c50a0f-e253-4843-96ee-771763d96eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62064db5-7786-40bb-be78-d5307b05a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62064db5-7786-40bb-be78-d5307b05a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f9690bd-0264-4306-9323-0e0f3c94529c', 'volume_name': 'volume-6f9690bd-0264-4306-9323-0e0f3c94529c', 'volume_size': 2, 'snapshot_id': '24621a68-a574-4fcd-9585-5f4666242b39'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807213dd-98fe-4c93-9313-5228bdbf6d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807213dd-98fe-4c93-9313-5228bdbf6d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd2d558-c568-4533-9aef-3b4fb670c8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:28 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Volume 6f9690bd-0264-4306-9323-0e0f3c94529c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f9690bd-0264-4306-9323-0e0f3c94529c', 'volume_size': 2, 'snapshot_id': '24621a68-a574-4fcd-9585-5f4666242b39'} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-24621a68-a574-4fcd-9585-5f4666242b39-6f9690bd-0264-4306-9323-0e0f3c94529c" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-24621a68-a574-4fcd-9585-5f4666242b39-6f9690bd-0264-4306-9323-0e0f3c94529c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Creating volume 6f9690bd-0264-4306-9323-0e0f3c94529c from snapshot 24621a68-a574-4fcd-9585-5f4666242b39 {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-6f9690bd-0264-4306-9323-0e0f3c94529c" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-6f9690bd-0264-4306-9323-0e0f3c94529c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] snapshot: 24621a68-a574-4fcd-9585-5f4666242b39, volume: 6f9690bd-0264-4306-9323-0e0f3c94529c, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3511c1e7-1842-4896-8ace-e96d4944d7b8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:28 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 Nov 05 03:52:28 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:28 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39" returned: 0 in 0.676s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26e05de4-14da-4e24-afdf-546ad69f6a8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae23a6-73a4-41eb-bd42-3ca9f25dfd28]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:29 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a Nov 05 03:52:29 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:29 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a" returned: 0 in 0.697s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:52:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:52:29 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:52:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:29 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c Nov 05 03:52:29 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:38 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=56,cinder:SELECT=58,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:52:38 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=49,cinder:SELECT=62,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:52:39 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c" returned: 0 in 9.897s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:52:39 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Converted 1024.00 MB image at 103.45 MB/s Nov 05 03:52:39 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c is being set with open permissions: ugo+rw Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:39 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c Nov 05 03:52:39 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:39 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c" returned: 0 in 0.302s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-6f9690bd-0264-4306-9323-0e0f3c94529c" released by "_copy_volume_from_snapshot" :: held 11.733s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-24621a68-a574-4fcd-9585-5f4666242b39-6f9690bd-0264-4306-9323-0e0f3c94529c" released by "_create_volume_from_snapshot" :: held 11.822s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.849s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd2d558-c568-4533-9aef-3b4fb670c8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9690bd-0264-4306-9323-0e0f3c94529c', 'volume_size': 2, 'snapshot_id': '24621a68-a574-4fcd-9585-5f4666242b39'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6156617-9980-4f27-871b-0f3f86dbec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:39 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Volume volume-6f9690bd-0264-4306-9323-0e0f3c94529c (6f9690bd-0264-4306-9323-0e0f3c94529c): created successfully Nov 05 03:52:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6156617-9980-4f27-871b-0f3f86dbec14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (87f27591-df70-41f5-b8a4-c612b8f7ab6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:40 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e39e0fcf-cc00-440a-af24-1055fdf0e8eb tempest-VolumesSnapshotTestJSON-1752262491 None] Created volume successfully. Nov 05 03:52:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-6f9690bd-0264-4306-9323-0e0f3c94529c-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-6f9690bd-0264-4306-9323-0e0f3c94529c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-6f9690bd-0264-4306-9323-0e0f3c94529c" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-6f9690bd-0264-4306-9323-0e0f3c94529c" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:40 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1eaff9-aec7-4189-86af-ac0c2334d260]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:41 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c Nov 05 03:52:41 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:41 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c" returned: 0 in 0.533s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:41 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c Nov 05 03:52:41 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:41 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f9690bd-0264-4306-9323-0e0f3c94529c" returned: 0 in 0.297s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-6f9690bd-0264-4306-9323-0e0f3c94529c" released by "delete_volume" :: held 0.925s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Created reservations ['9464094d-6748-455e-8ca2-ed2739c3e54f', '4a4345fa-bea5-4942-967e-29cc444a054d', 'c56bc953-05dd-45c5-9395-0f69f06a5f84', '4f90d77a-ccad-42cf-84c9-ecee6cbdea0c'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:41 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:52:41 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:42 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.304s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:42 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:42 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Deleted volume successfully. Nov 05 03:52:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-642a5e7d-c877-4dfe-9f25-a83f0c25c09b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-6f9690bd-0264-4306-9323-0e0f3c94529c-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-24621a68-a574-4fcd-9585-5f4666242b39-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-24621a68-a574-4fcd-9585-5f4666242b39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-26e05de4-14da-4e24-afdf-546ad69f6a8a" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-26e05de4-14da-4e24-afdf-546ad69f6a8a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-24621a68-a574-4fcd-9585-5f4666242b39" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-24621a68-a574-4fcd-9585-5f4666242b39" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Deleting offline snapshot 24621a68-a574-4fcd-9585-5f4666242b39 of volume 26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] snapshot_file for this snap is: volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c66841a-95b3-4874-982e-8abe1786bc78]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:43 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 Nov 05 03:52:43 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:43 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39" returned: 0 in 0.456s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26e05de4-14da-4e24-afdf-546ad69f6a8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb5ce24-e7cf-4c15-9ddf-738a33a16868]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:43 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a Nov 05 03:52:43 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:44 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a" returned: 0 in 0.593s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:44 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 Nov 05 03:52:44 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:44 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39" returned: 0 in 0.474s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:44 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39 Nov 05 03:52:44 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:45 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a.24621a68-a574-4fcd-9585-5f4666242b39" returned: 0 in 0.357s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-24621a68-a574-4fcd-9585-5f4666242b39" released by "_delete_snapshot" :: held 2.040s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-26e05de4-14da-4e24-afdf-546ad69f6a8a" released by "delete_snapshot" :: held 2.071s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:45 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Created reservations ['1bb7135f-b4ca-4a30-9344-5b5fd814b9df', '9dcecdeb-b313-4793-8055-2ce654e868d9', '86ab8b3c-c090-4e32-8a82-8b6d0e5f695b', 'f208c5fb-a85c-4723-a953-3a3181199ce4'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:45 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Delete snapshot completed successfully. Nov 05 03:52:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a0a049bb-bf2d-4ac8-867d-80fcc2414004 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-24621a68-a574-4fcd-9585-5f4666242b39-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-26e05de4-14da-4e24-afdf-546ad69f6a8a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-26e05de4-14da-4e24-afdf-546ad69f6a8a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-26e05de4-14da-4e24-afdf-546ad69f6a8a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-26e05de4-14da-4e24-afdf-546ad69f6a8a" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:46 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7e613-2625-4d91-87e1-c003ac7bbac2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:46 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a Nov 05 03:52:46 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:47 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a" returned: 0 in 0.475s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:47 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a Nov 05 03:52:47 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:47 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-26e05de4-14da-4e24-afdf-546ad69f6a8a" returned: 0 in 0.285s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-26e05de4-14da-4e24-afdf-546ad69f6a8a" released by "delete_volume" :: held 0.873s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Created reservations ['a4834735-f64e-4681-acdc-0193eff9c858', '79742fbe-70cc-4f00-8724-891069a7ca4a', 'd9fd7547-9544-4498-8f33-fcbc0973e4ea', '3fc486d7-fbcf-4a17-9c49-b84e6b82fcb2'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:47 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:52:47 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:47 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:47 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Deleted volume successfully. Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-35aefa33-5234-4e1d-ba3d-bd00e765f0e1 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-26e05de4-14da-4e24-afdf-546ad69f6a8a-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (ba5a952f-5691-44c1-b5af-29cb53ee2d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5ef6af-7f75-4e27-90de-44e1036f79c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5ef6af-7f75-4e27-90de-44e1036f79c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1792395810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f1270dfd44b94b0c42f7207275006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:48Z,use_quota=True,user_id='8b970043d0d049208d27c2d8b427a1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (066cee25-ea60-4ef3-8dc0-e86a831cc653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (066cee25-ea60-4ef3-8dc0-e86a831cc653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60905173-00e5-4293-80e8-c5b93a13bd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60905173-00e5-4293-80e8-c5b93a13bd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05', 'volume_name': 'volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab72c8c3-a9db-4d5a-953b-0433cf9dec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab72c8c3-a9db-4d5a-953b-0433cf9dec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae503cba-b023-4d2d-99b6-7b9f40a90d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:48 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume 1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05', 'volume_size': 1} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1792395810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f1270dfd44b94b0c42f7207275006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:48Z,use_quota=True,user_id='8b970043d0d049208d27c2d8b427a1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Creating volume 1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:48 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:52:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:48 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 1073741824 Nov 05 03:52:48 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:49 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 1073741824" returned: 0 in 0.919s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:49 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 Nov 05 03:52:49 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:50 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" returned: 0 in 0.525s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae503cba-b023-4d2d-99b6-7b9f40a90d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2434f63-98a5-43a8-83b8-b3e9d464569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 (1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05): created successfully Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2434f63-98a5-43a8-83b8-b3e9d464569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (ba5a952f-5691-44c1-b5af-29cb53ee2d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0f96784f-1a8c-4cd8-b721-694cb2350f94 tempest-VolumesSnapshotTestJSON-1752262491 None] Created volume successfully. Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Flow 'volume_create_manager' (eb8e3954-4d64-416e-84d9-329b20aef438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11dff14c-c6b3-4f68-b4d7-902959ca53c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11dff14c-c6b3-4f68-b4d7-902959ca53c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1795841355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d23675-276d-47be-bc83-3b83026243f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932062b556d34e5d9970fa8db2ab8754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:50Z,use_quota=True,user_id='70b900a0ed1b4f688653eccad1829859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9782b16-5e3f-4b8e-8e0f-66fa89ed1539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9782b16-5e3f-4b8e-8e0f-66fa89ed1539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1659bc90-6439-485d-980b-90a6d18b8ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1659bc90-6439-485d-980b-90a6d18b8ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d23675-276d-47be-bc83-3b83026243f4', 'volume_name': 'volume-51d23675-276d-47be-bc83-3b83026243f4', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b055d154-41ab-49cc-9951-69cd17fc4780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b055d154-41ab-49cc-9951-69cd17fc4780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb67cc33-3d07-469f-a050-8d87e137343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Volume 51d23675-276d-47be-bc83-3b83026243f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d23675-276d-47be-bc83-3b83026243f4', 'volume_size': 1} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1795841355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d23675-276d-47be-bc83-3b83026243f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932062b556d34e5d9970fa8db2ab8754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:50Z,use_quota=True,user_id='70b900a0ed1b4f688653eccad1829859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Creating volume 51d23675-276d-47be-bc83-3b83026243f4 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:50 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:50 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 1073741824 Nov 05 03:52:50 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:51 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 1073741824" returned: 0 in 0.607s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:51 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 Nov 05 03:52:51 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:51 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4" returned: 0 in 0.263s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.417s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb67cc33-3d07-469f-a050-8d87e137343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d23675-276d-47be-bc83-3b83026243f4', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb58fc99-a4e5-4977-979b-e0569d60b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Creating offline snapshot 0e87f31f-2483-432c-8560-f489559b861d of volume 1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:52:51 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Volume volume-51d23675-276d-47be-bc83-3b83026243f4 (51d23675-276d-47be-bc83-3b83026243f4): created successfully Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb58fc99-a4e5-4977-979b-e0569d60b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Flow 'volume_create_manager' (eb8e3954-4d64-416e-84d9-329b20aef438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f6c784-a7ad-41ed-90a7-238b7e74f42c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-21e397a3-7489-4361-bd73-10094b18e4ca tempest-AttachVolumeNegativeTest-758846370 None] Created volume successfully. Nov 05 03:52:51 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 Nov 05 03:52:51 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:51 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" returned: 0 in 0.463s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:51 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d 1G Nov 05 03:52:51 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:52 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d 1G" returned: 0 in 0.664s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:52 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d Nov 05 03:52:52 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (e5989b67-66f0-4222-b307-ff9e13c42b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7283cb-249d-48c4-9d93-00cfc9f8f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7283cb-249d-48c4-9d93-00cfc9f8f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819923067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422c00c7-543a-467f-bf30-a39957f15198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:53Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87a076-cec4-4e71-91d5-5b6d7e034689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87a076-cec4-4e71-91d5-5b6d7e034689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490cc0eb-a737-46d1-b02f-670403ec7fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490cc0eb-a737-46d1-b02f-670403ec7fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422c00c7-543a-467f-bf30-a39957f15198', 'volume_name': 'volume-422c00c7-543a-467f-bf30-a39957f15198', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db93272-6f8a-4b29-b347-d25171b15370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db93272-6f8a-4b29-b347-d25171b15370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca7e1c9-23e3-4ba1-a11c-4aa17eb28669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Volume 422c00c7-543a-467f-bf30-a39957f15198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422c00c7-543a-467f-bf30-a39957f15198', 'volume_size': 1} Nov 05 03:52:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:53 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d" returned: 0 in 0.476s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:53 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d is being set with open permissions: ugo+rw Nov 05 03:52:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:53 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d Nov 05 03:52:53 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:53 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:53 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.info Nov 05 03:52:53 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1f605a6f-800f-4acd-9fa4-e9dc10384090 req-7ab76b46-8ac9-4596-a088-06813bcbe9a4 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:53 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.info" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:53 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.info is being set with open permissions: ugo+rw Nov 05 03:52:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:53 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.info Nov 05 03:52:53 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:54 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.info" returned: 0 in 0.258s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.115s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819923067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422c00c7-543a-467f-bf30-a39957f15198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:53Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Creating volume 422c00c7-543a-467f-bf30-a39957f15198 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:54 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:54 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 1073741824 Nov 05 03:52:54 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:54 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2580be82-0aae-4dab-a81b-7285c241a2a3 tempest-VolumesSnapshotTestJSON-1752262491 None] Create snapshot completed successfully Nov 05 03:52:54 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 1073741824" returned: 0 in 0.468s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:54 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 Nov 05 03:52:54 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:54 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198" returned: 0 in 0.254s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1f605a6f-800f-4acd-9fa4-e9dc10384090 req-7ab76b46-8ac9-4596-a088-06813bcbe9a4 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.202s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca7e1c9-23e3-4ba1-a11c-4aa17eb28669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422c00c7-543a-467f-bf30-a39957f15198', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b513bf91-4962-4735-a7a9-8c101eeb8550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1f605a6f-800f-4acd-9fa4-e9dc10384090 req-7ab76b46-8ac9-4596-a088-06813bcbe9a4 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Volume volume-422c00c7-543a-467f-bf30-a39957f15198 (422c00c7-543a-467f-bf30-a39957f15198): created successfully Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b513bf91-4962-4735-a7a9-8c101eeb8550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (e5989b67-66f0-4222-b307-ff9e13c42b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:54 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-562f2e5b-e744-40b2-a88e-77bd0e851d72 tempest-VolumesActionsTest-2072990577 None] Created volume successfully. Nov 05 03:52:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-1f605a6f-800f-4acd-9fa4-e9dc10384090 req-7ab76b46-8ac9-4596-a088-06813bcbe9a4 tempest-AttachVolumeNegativeTest-758846370 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-51d23675-276d-47be-bc83-3b83026243f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b226448-f85a-4213-8331-06119717dc25', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:52:54 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-1f605a6f-800f-4acd-9fa4-e9dc10384090 req-7ab76b46-8ac9-4596-a088-06813bcbe9a4 tempest-AttachVolumeNegativeTest-758846370 None] attachment_update completed successfully. Nov 05 03:52:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e92e8d5d-f5ec-457d-be57-8bb9335e25d9 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "cinder-422c00c7-543a-467f-bf30-a39957f15198" by "attach_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e92e8d5d-f5ec-457d-be57-8bb9335e25d9 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-422c00c7-543a-467f-bf30-a39957f15198" acquired by "attach_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:55 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e92e8d5d-f5ec-457d-be57-8bb9335e25d9 tempest-VolumesActionsTest-2072990577 None] Attaching volume 422c00c7-543a-467f-bf30-a39957f15198 to instance cd779a59-818c-4774-88ba-4a453a9baae4 at mountpoint /dev/vdb on host None. Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (197a585c-d476-4476-91a3-be4ed1dfdd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e163f124-3e3d-4bf7-b857-3ef768687b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e163f124-3e3d-4bf7-b857-3ef768687b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1790841204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3642c28f-00c4-4069-b314-e3a3f0210c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4f1270dfd44b94b0c42f7207275006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e87f31f-2483-432c-8560-f489559b861d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:56Z,use_quota=True,user_id='8b970043d0d049208d27c2d8b427a1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b172c19d-8f11-49e5-97c2-2e603021a288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b172c19d-8f11-49e5-97c2-2e603021a288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6668643-4dab-46cc-bd78-6674a6557eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6668643-4dab-46cc-bd78-6674a6557eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3642c28f-00c4-4069-b314-e3a3f0210c84', 'volume_name': 'volume-3642c28f-00c4-4069-b314-e3a3f0210c84', 'volume_size': 1, 'snapshot_id': '0e87f31f-2483-432c-8560-f489559b861d'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e189938d-2bac-49ca-9c5e-1691cf6efb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e189938d-2bac-49ca-9c5e-1691cf6efb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d611e197-9f20-4351-bc11-72176b9de0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:56 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume 3642c28f-00c4-4069-b314-e3a3f0210c84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3642c28f-00c4-4069-b314-e3a3f0210c84', 'volume_size': 1, 'snapshot_id': '0e87f31f-2483-432c-8560-f489559b861d'} Nov 05 03:52:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e92e8d5d-f5ec-457d-be57-8bb9335e25d9 tempest-VolumesActionsTest-2072990577 None] Attach volume completed successfully. Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-0e87f31f-2483-432c-8560-f489559b861d-3642c28f-00c4-4069-b314-e3a3f0210c84" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e92e8d5d-f5ec-457d-be57-8bb9335e25d9 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-422c00c7-543a-467f-bf30-a39957f15198" released by "attach_volume" :: held 0.217s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-0e87f31f-2483-432c-8560-f489559b861d-3642c28f-00c4-4069-b314-e3a3f0210c84" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Creating volume 3642c28f-00c4-4069-b314-e3a3f0210c84 from snapshot 0e87f31f-2483-432c-8560-f489559b861d {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-3642c28f-00c4-4069-b314-e3a3f0210c84" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-3642c28f-00c4-4069-b314-e3a3f0210c84" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] snapshot: 0e87f31f-2483-432c-8560-f489559b861d, volume: 3642c28f-00c4-4069-b314-e3a3f0210c84, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab53b849-c046-4d82-b177-dab35601cfad]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:56 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d Nov 05 03:52:56 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:56 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d" returned: 0 in 0.421s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f564b735-c843-43d8-b234-9dbe84f11dfc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9557dc11-09c2-44f8-be8e-83a9569bc93f tempest-VolumesActionsTest-1618244594 None] Terminate volume connection completed successfully. Nov 05 03:52:56 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 Nov 05 03:52:56 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9557dc11-09c2-44f8-be8e-83a9569bc93f tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-detach_volume" by "detach_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9557dc11-09c2-44f8-be8e-83a9569bc93f tempest-VolumesActionsTest-1618244594 None] Lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9557dc11-09c2-44f8-be8e-83a9569bc93f tempest-VolumesActionsTest-1618244594 None] Detaching volume 422c00c7-543a-467f-bf30-a39957f15198 from instance cd779a59-818c-4774-88ba-4a453a9baae4. Nov 05 03:52:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9557dc11-09c2-44f8-be8e-83a9569bc93f tempest-VolumesActionsTest-1618244594 None] Detach volume completed successfully. Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9557dc11-09c2-44f8-be8e-83a9569bc93f tempest-VolumesActionsTest-1618244594 None] Lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:57 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" returned: 0 in 0.577s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-48f067bb-9802-4253-9c5d-b8e0c61ad559 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-detach_volume" by "detach_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:57 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 Nov 05 03:52:57 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-48f067bb-9802-4253-9c5d-b8e0c61ad559 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-48f067bb-9802-4253-9c5d-b8e0c61ad559 tempest-VolumesActionsTest-2072990577 None] Volume detach called, but volume not attached. Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-48f067bb-9802-4253-9c5d-b8e0c61ad559 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-461ddf90-f104-4ce4-a35d-ef9b7cf4d602 req-4ff41305-d98d-4885-b9ae-65881847f371 tempest-AttachVolumeNegativeTest-758846370 None] Terminate volume connection completed successfully. Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-461ddf90-f104-4ce4-a35d-ef9b7cf4d602 req-4ff41305-d98d-4885-b9ae-65881847f371 tempest-AttachVolumeNegativeTest-758846370 None] Deleting attachment 8b226448-f85a-4213-8331-06119717dc25. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "cinder-quobyte-422c00c7-543a-467f-bf30-a39957f15198" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-quobyte-422c00c7-543a-467f-bf30-a39957f15198" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0578001-2759-4fdf-af2b-9607c2b3beb5]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:58 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 Nov 05 03:52:58 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:58 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198" returned: 0 in 0.895s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:58 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198 Nov 05 03:52:58 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:59 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-422c00c7-543a-467f-bf30-a39957f15198" returned: 0 in 1.031s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-quobyte-422c00c7-543a-467f-bf30-a39957f15198" released by "delete_volume" :: held 2.137s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:00 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Created reservations ['862a3c41-7ec0-4b46-9d10-34772f6398cc', '2dc3eed8-163d-4f3f-97af-51c0a55b2f0d', '506d1883-c83d-4ee0-88e8-703aa5bf6140', '5c618e65-473b-40d0-b3aa-71db9831a6eb'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:00 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:00 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:01 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.759s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:01 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Deleted volume successfully. Nov 05 03:53:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a2185f16-b724-4cb4-ba75-55ebaa38cd89 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-422c00c7-543a-467f-bf30-a39957f15198-delete_volume" released by "delete_volume" :: held 3.679s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:07 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84" returned: 0 in 10.496s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05, size 1024.00 MB, duration 10.50 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:53:07 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Converted 1024.00 MB image at 97.55 MB/s Nov 05 03:53:07 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 is being set with open permissions: ugo+rw Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:07 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 Nov 05 03:53:07 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "cinder-51d23675-276d-47be-bc83-3b83026243f4-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-51d23675-276d-47be-bc83-3b83026243f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "cinder-quobyte-51d23675-276d-47be-bc83-3b83026243f4" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-quobyte-51d23675-276d-47be-bc83-3b83026243f4" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5647c56a-3911-4e6a-b1db-08dd137baec2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:08 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84" returned: 0 in 0.337s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-3642c28f-00c4-4069-b314-e3a3f0210c84" released by "_copy_volume_from_snapshot" :: held 11.952s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-0e87f31f-2483-432c-8560-f489559b861d-3642c28f-00c4-4069-b314-e3a3f0210c84" released by "_create_volume_from_snapshot" :: held 12.054s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.076s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:08 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 Nov 05 03:53:08 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d611e197-9f20-4351-bc11-72176b9de0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3642c28f-00c4-4069-b314-e3a3f0210c84', 'volume_size': 1, 'snapshot_id': '0e87f31f-2483-432c-8560-f489559b861d'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bf8712-b250-448d-8bf2-c28009c4e01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:08 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Volume volume-3642c28f-00c4-4069-b314-e3a3f0210c84 (3642c28f-00c4-4069-b314-e3a3f0210c84): created successfully Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bf8712-b250-448d-8bf2-c28009c4e01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Flow 'volume_create_manager' (197a585c-d476-4476-91a3-be4ed1dfdd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:08 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a99e9bad-f191-44bc-9d91-345d94bc6e81 tempest-VolumesSnapshotTestJSON-1752262491 None] Created volume successfully. Nov 05 03:53:08 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-3642c28f-00c4-4069-b314-e3a3f0210c84-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4" returned: 0 in 0.638s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-3642c28f-00c4-4069-b314-e3a3f0210c84-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:08 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4 Nov 05 03:53:08 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-3642c28f-00c4-4069-b314-e3a3f0210c84" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (53c3b64b-850f-46ed-9533-9ac9ad39fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759d6837-8b0c-4460-a93f-048789c39565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-3642c28f-00c4-4069-b314-e3a3f0210c84" acquired by "delete_volume" :: waited 0.059s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759d6837-8b0c-4460-a93f-048789c39565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-831809985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abace75-f32d-4ffa-afd7-276aa1114583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:09Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c014d3-e6fc-460d-af69-82c62a2d13a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c014d3-e6fc-460d-af69-82c62a2d13a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6003e28-41f2-4757-8c67-f54c6c918929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6003e28-41f2-4757-8c67-f54c6c918929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abace75-f32d-4ffa-afd7-276aa1114583', 'volume_name': 'volume-8abace75-f32d-4ffa-afd7-276aa1114583', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a848b9ac-5331-4811-baa0-e5d08626d44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a848b9ac-5331-4811-baa0-e5d08626d44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c86e7b1-b740-4b1e-a6db-c9b5cb419594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:08 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Volume 8abace75-f32d-4ffa-afd7-276aa1114583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abace75-f32d-4ffa-afd7-276aa1114583', 'volume_size': 1} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-831809985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abace75-f32d-4ffa-afd7-276aa1114583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:09Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Creating volume 8abace75-f32d-4ffa-afd7-276aa1114583 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:08 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae38e2b-d6a7-41da-995f-de67120ee6a3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:08 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 1073741824 Nov 05 03:53:08 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:09 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 Nov 05 03:53:09 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:09 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-51d23675-276d-47be-bc83-3b83026243f4" returned: 0 in 0.409s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-quobyte-51d23675-276d-47be-bc83-3b83026243f4" released by "delete_volume" :: held 1.116s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Created reservations ['c347ded2-8f04-464f-b5d5-f9d3d64e6f41', 'de902df9-32f2-4862-baa6-6f5bbb2ad8e1', '21f8b3d5-1d27-4695-9805-7e823682afd0', '11d3ca76-9f95-4d1c-971f-3ccef96d616d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:09 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:09 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:09 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84" returned: 0 in 0.456s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:09 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84 Nov 05 03:53:09 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:09 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 1073741824" returned: 0 in 0.594s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:09 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.349s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:09 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Deleted volume successfully. Nov 05 03:53:09 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 Nov 05 03:53:09 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5573bc67-8535-4454-b1e1-197d8772c81a tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-51d23675-276d-47be-bc83-3b83026243f4-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:09 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3642c28f-00c4-4069-b314-e3a3f0210c84" returned: 0 in 0.386s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-3642c28f-00c4-4069-b314-e3a3f0210c84" released by "delete_volume" :: held 0.980s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Created reservations ['e0225d76-576a-4140-8134-3e49ae8ce603', 'dbdd0312-f676-48a5-9245-34cff6898563', '5302b6a1-6262-4900-9b62-223a92425ab8', 'd9ed1cec-65cf-4ab7-b6d4-fa577e8c1457'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:09 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583" returned: 0 in 0.324s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c86e7b1-b740-4b1e-a6db-c9b5cb419594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abace75-f32d-4ffa-afd7-276aa1114583', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e27dd5-fe50-4732-bc00-d9ef9f0d55bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:09 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Volume volume-8abace75-f32d-4ffa-afd7-276aa1114583 (8abace75-f32d-4ffa-afd7-276aa1114583): created successfully Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e27dd5-fe50-4732-bc00-d9ef9f0d55bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (53c3b64b-850f-46ed-9533-9ac9ad39fa91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:09 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fdf2e0bf-c852-4fd3-81a0-bf12ad80e957 tempest-VolumesActionsTest-2072990577 None] Created volume successfully. Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:10 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:10 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "cinder-c146c419-5128-4d2e-b9fa-33e07887d803-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-c146c419-5128-4d2e-b9fa-33e07887d803-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:10 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.273s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Deleted volume successfully. Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "cinder-quobyte-c146c419-5128-4d2e-b9fa-33e07887d803" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f521a4f0-060a-4113-807f-03c0bb27aeb7 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-3642c28f-00c4-4069-b314-e3a3f0210c84-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-quobyte-c146c419-5128-4d2e-b9fa-33e07887d803" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3618eb48-cad9-46be-bfe8-6204c5375f47]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:10 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 Nov 05 03:53:10 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:10 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803" returned: 0 in 0.414s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:10 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803 Nov 05 03:53:10 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-0e87f31f-2483-432c-8560-f489559b861d-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-8abace75-f32d-4ffa-afd7-276aa1114583-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:11 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-0e87f31f-2483-432c-8560-f489559b861d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c146c419-5128-4d2e-b9fa-33e07887d803" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-8abace75-f32d-4ffa-afd7-276aa1114583-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-quobyte-c146c419-5128-4d2e-b9fa-33e07887d803" released by "delete_volume" :: held 0.809s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-0e87f31f-2483-432c-8560-f489559b861d" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-0e87f31f-2483-432c-8560-f489559b861d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Deleting offline snapshot 0e87f31f-2483-432c-8560-f489559b861d of volume 1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] snapshot_file for this snap is: volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a7f61c-0f54-441b-889e-c915263e1664]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-quobyte-8abace75-f32d-4ffa-afd7-276aa1114583" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-quobyte-8abace75-f32d-4ffa-afd7-276aa1114583" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Created reservations ['3661875f-f3c6-42c8-8173-1cd562e519c2', 'eff0edb9-06ba-45cb-9ebd-99addbf33963', 'd880b040-de99-4db5-ba4b-f829f213e6bd', 'ae06e3e2-f5d4-4dd7-82dc-5d340144e1fe'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35a83c-ce21-452c-89e3-d29f55cbd2f0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:11 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d Nov 05 03:53:11 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:11 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:11 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:11 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 Nov 05 03:53:11 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:11 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d" returned: 0 in 0.513s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:11 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.313s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Deleted volume successfully. Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e20b3fb-30fc-452e-9151-1b9be8cb2651]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-049291ee-dfe0-405c-8509-35fdc6dee9fa tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-c146c419-5128-4d2e-b9fa-33e07887d803-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:11 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583" returned: 0 in 0.485s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:11 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583 Nov 05 03:53:11 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:11 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 Nov 05 03:53:11 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:12 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8abace75-f32d-4ffa-afd7-276aa1114583" returned: 0 in 0.284s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-quobyte-8abace75-f32d-4ffa-afd7-276aa1114583" released by "delete_volume" :: held 0.852s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Created reservations ['af1f5b17-2dcc-436a-9bfa-33f46edda265', 'e4340160-548f-41c6-a1a9-7404fd3e5b59', 'adadf9c2-f48e-42b2-af8c-f853790e1d4d', 'c3d1833d-013e-4235-80f1-69b8dc6d051b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:12 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:12 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:12 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" returned: 0 in 0.681s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:12 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d Nov 05 03:53:12 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:12 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.284s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:12 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Deleted volume successfully. Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fa0690f1-0ba6-4390-9a3d-acb518377031 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-8abace75-f32d-4ffa-afd7-276aa1114583-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "cinder-c9d85386-e8d7-4fd0-865d-52f4f56a59a9-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-c9d85386-e8d7-4fd0-865d-52f4f56a59a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "cinder-quobyte-c9d85386-e8d7-4fd0-865d-52f4f56a59a9" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-quobyte-c9d85386-e8d7-4fd0-865d-52f4f56a59a9" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3898e424-7b2b-4f71-a2b9-38e52bc3e434]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:12 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d" returned: 0 in 0.432s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:12 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d Nov 05 03:53:12 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:12 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 Nov 05 03:53:12 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:13 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05.0e87f31f-2483-432c-8560-f489559b861d" returned: 0 in 0.300s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-0e87f31f-2483-432c-8560-f489559b861d" released by "_delete_snapshot" :: held 2.071s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" released by "delete_snapshot" :: held 2.111s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:13 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9" returned: 0 in 0.450s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:13 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9 Nov 05 03:53:13 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Created reservations ['cced5f19-062b-47f0-8594-9d841a7a7c27', 'df8e5145-150f-42e6-be36-3b0f271f944f', '4b957fb7-1b10-47ac-8611-62c0cc89ee93', '039edd07-aed1-43d4-b463-5f6b74740c2e'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Delete snapshot completed successfully. Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8929adae-d106-4834-b316-258d41925ec3 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-0e87f31f-2483-432c-8560-f489559b861d-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:13 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c9d85386-e8d7-4fd0-865d-52f4f56a59a9" returned: 0 in 0.329s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-quobyte-c9d85386-e8d7-4fd0-865d-52f4f56a59a9" released by "delete_volume" :: held 0.827s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Created reservations ['bece5ab3-d4ec-4fc9-b3ba-d3a1d4735940', 'e5ac191b-558d-46a0-9691-305660369d74', 'ffcdabb6-99c6-4aee-8073-188e05dc7a1e', 'c97aa088-5e95-4132-b6d1-0b2467844e61'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:13 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:13 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (3a4b7936-0ff6-40cc-9e77-ebec3f4795ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1fa308-5ef0-4c83-aa69-557dd1e2742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1fa308-5ef0-4c83-aa69-557dd1e2742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-218362332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adba351c-e90a-4229-af6a-5d4d2484c601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:14Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f509169-5444-4551-a8d6-d191e69838b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f509169-5444-4551-a8d6-d191e69838b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a802c0f-9b58-4206-8b92-a8703d5692df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a802c0f-9b58-4206-8b92-a8703d5692df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adba351c-e90a-4229-af6a-5d4d2484c601', 'volume_name': 'volume-adba351c-e90a-4229-af6a-5d4d2484c601', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499b82f2-562b-485f-a480-10c34c21a656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499b82f2-562b-485f-a480-10c34c21a656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e850f28-5ffa-46a7-997f-c4ffe40fe0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Volume adba351c-e90a-4229-af6a-5d4d2484c601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adba351c-e90a-4229-af6a-5d4d2484c601', 'volume_size': 1} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-218362332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adba351c-e90a-4229-af6a-5d4d2484c601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:14Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Creating volume adba351c-e90a-4229-af6a-5d4d2484c601 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:14 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:14 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 1073741824 Nov 05 03:53:14 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:14 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.339s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Deleted volume successfully. Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980ce13c-d443-4b9e-bae5-c47763003115 tempest-AttachVolumeNegativeTest-758846370 None] Lock "cinder-c9d85386-e8d7-4fd0-865d-52f4f56a59a9-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d3852-3671-489d-a774-273d2f201ff9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:14 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 1073741824" returned: 0 in 0.640s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:14 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 Nov 05 03:53:14 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:14 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 Nov 05 03:53:14 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:15 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" returned: 0 in 0.487s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:15 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05 Nov 05 03:53:15 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:15 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601" returned: 0 in 0.364s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e850f28-5ffa-46a7-997f-c4ffe40fe0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adba351c-e90a-4229-af6a-5d4d2484c601', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a43556-cf1f-4257-9df9-cd00e1bdf490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:15 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Volume volume-adba351c-e90a-4229-af6a-5d4d2484c601 (adba351c-e90a-4229-af6a-5d4d2484c601): created successfully Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a43556-cf1f-4257-9df9-cd00e1bdf490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (3a4b7936-0ff6-40cc-9e77-ebec3f4795ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-71ce427d-5ec0-4c02-8776-1856252dc778 tempest-VolumesActionsTest-2072990577 None] Created volume successfully. Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:15 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:15 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:15 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" returned: 0 in 0.342s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05" released by "delete_volume" :: held 0.923s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Created reservations ['38b3fde1-e20e-449a-88b1-d1835e95f573', '38053cc1-4d1e-42e9-9420-28f75f05d253', '960ea07d-6ac4-4d8a-95bf-8b8533d76440', '081a8ccc-0106-489e-b25f-60c7e323503f'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:15 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:15 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:15 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.413s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-46c906dc-baad-4162-8df8-50e95c54c714-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-46c906dc-baad-4162-8df8-50e95c54c714-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "cinder-quobyte-46c906dc-baad-4162-8df8-50e95c54c714" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-46c906dc-baad-4162-8df8-50e95c54c714" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a988c91e-b530-4e06-81d3-ec80943c7b78]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:16 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.381s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:16 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Deleted volume successfully. Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-72fd4ead-122e-4c25-bd95-67406f58883b tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-1b33a5fe-f52f-4977-b9dc-dd7c21b1ee05-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:16 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 Nov 05 03:53:16 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-adba351c-e90a-4229-af6a-5d4d2484c601-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-adba351c-e90a-4229-af6a-5d4d2484c601-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-quobyte-adba351c-e90a-4229-af6a-5d4d2484c601" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-quobyte-adba351c-e90a-4229-af6a-5d4d2484c601" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a961976-4324-4d74-9d48-ab61e844ea66]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:16 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714" returned: 0 in 0.623s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:16 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714 Nov 05 03:53:16 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:16 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 Nov 05 03:53:16 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:16 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-46c906dc-baad-4162-8df8-50e95c54c714" returned: 0 in 0.297s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-quobyte-46c906dc-baad-4162-8df8-50e95c54c714" released by "delete_volume" :: held 1.026s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:16 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Created reservations ['e56bc0fd-2899-4d68-bebd-8fdba4d4987e', '3798cfcb-243a-451e-86ad-15341ffc028c', 'cc50288f-e9fa-4d46-b64d-fdcd65055655', '60fb2488-1e27-45c1-a83a-de5791de9258'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:17 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601" returned: 0 in 0.502s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:17 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601 Nov 05 03:53:17 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:17 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-adba351c-e90a-4229-af6a-5d4d2484c601" returned: 0 in 0.379s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-quobyte-adba351c-e90a-4229-af6a-5d4d2484c601" released by "delete_volume" :: held 0.954s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:17 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.363s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Deleted volume successfully. Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3773486d-c09d-402d-a4f2-3735a49a8e33 tempest-VolumesSnapshotTestJSON-1752262491 None] Lock "cinder-46c906dc-baad-4162-8df8-50e95c54c714-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Created reservations ['f6ceb31a-540a-4bfd-beb1-fe6bdeeb5a5f', '1dbf32be-8067-45c3-9bb6-0d227866557a', 'f01d2cf0-aab0-495c-a6c5-db391e14cf5c', 'd1cf20b2-11f1-4313-99b2-ed87a3ad29b9'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:17 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.281s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Deleted volume successfully. Nov 05 03:53:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2127803b-c71a-45c4-9d8f-555bdb7c72a1 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-adba351c-e90a-4229-af6a-5d4d2484c601-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (9bbb7b1c-ccea-4184-9ba1-fbb869dc02a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f70d3e2-a265-4259-9073-f81bf3874096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f70d3e2-a265-4259-9073-f81bf3874096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-950769893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8aa76c-f976-4237-85ed-a0d134667ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:19Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc9c255-dd07-4e30-b84b-e45c16dc6cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc9c255-dd07-4e30-b84b-e45c16dc6cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66b0ca9-60e9-45b8-b4e3-44fa7e2ff747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66b0ca9-60e9-45b8-b4e3-44fa7e2ff747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8aa76c-f976-4237-85ed-a0d134667ea6', 'volume_name': 'volume-1d8aa76c-f976-4237-85ed-a0d134667ea6', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ebadd2-575b-48a6-afaa-2b3c1b80d9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ebadd2-575b-48a6-afaa-2b3c1b80d9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd8c56d-f851-4547-b41c-005d99274a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Volume 1d8aa76c-f976-4237-85ed-a0d134667ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8aa76c-f976-4237-85ed-a0d134667ea6', 'volume_size': 1} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-950769893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8aa76c-f976-4237-85ed-a0d134667ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:19Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Creating volume 1d8aa76c-f976-4237-85ed-a0d134667ea6 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:19 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:19 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 1073741824 Nov 05 03:53:19 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:19 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 1073741824" returned: 0 in 0.565s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:19 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 Nov 05 03:53:19 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:20 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6" returned: 0 in 0.275s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd8c56d-f851-4547-b41c-005d99274a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8aa76c-f976-4237-85ed-a0d134667ea6', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213155cb-14cd-421b-9f53-796c09eb5011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Volume volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 (1d8aa76c-f976-4237-85ed-a0d134667ea6): created successfully Nov 05 03:53:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213155cb-14cd-421b-9f53-796c09eb5011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (9bbb7b1c-ccea-4184-9ba1-fbb869dc02a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-538450d2-53e7-43d3-8d19-ee14f7d3604d tempest-VolumesActionsTest-2072990577 None] Created volume successfully. Nov 05 03:53:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-1d8aa76c-f976-4237-85ed-a0d134667ea6-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-1d8aa76c-f976-4237-85ed-a0d134667ea6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-quobyte-1d8aa76c-f976-4237-85ed-a0d134667ea6" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-quobyte-1d8aa76c-f976-4237-85ed-a0d134667ea6" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:21 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6247679-1bc9-471e-9e60-c9ca622b73b9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:21 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 Nov 05 03:53:21 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:22 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6" returned: 0 in 0.401s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:22 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6 Nov 05 03:53:22 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:22 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1d8aa76c-f976-4237-85ed-a0d134667ea6" returned: 0 in 0.349s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-quobyte-1d8aa76c-f976-4237-85ed-a0d134667ea6" released by "delete_volume" :: held 0.807s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Created reservations ['fcdf3a70-985c-47b6-8b52-6b774b1b752a', '0e16b71f-d1c6-4e79-9978-5f4b0b54b13f', '31672cba-ea94-43b2-9b52-d3593cdd7629', '922a9a87-1e0d-42c2-8c14-2128360177bb'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:22 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:22 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:22 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.353s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:22 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:22 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Deleted volume successfully. Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d6cb69ea-f9cf-46a2-b40d-ba8110517170 tempest-VolumesActionsTest-1618244594 None] Lock "cinder-1d8aa76c-f976-4237-85ed-a0d134667ea6-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (c630c414-ec20-406d-a20b-68995fec0b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90214352-8d70-4827-b161-aa3d23c468e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90214352-8d70-4827-b161-aa3d23c468e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-564636890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44db7b9-3004-46df-975c-65ec9c243140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:23Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc3cc46-1ab8-49b4-8f84-4215da138d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc3cc46-1ab8-49b4-8f84-4215da138d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f94db72-31b2-467c-b69f-e6495977e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f94db72-31b2-467c-b69f-e6495977e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44db7b9-3004-46df-975c-65ec9c243140', 'volume_name': 'volume-a44db7b9-3004-46df-975c-65ec9c243140', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61eae420-f92a-4b5d-a6e9-2ffaaf3e8fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61eae420-f92a-4b5d-a6e9-2ffaaf3e8fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb649b1-9b9b-4a86-a187-57275257dc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Volume a44db7b9-3004-46df-975c-65ec9c243140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44db7b9-3004-46df-975c-65ec9c243140', 'volume_size': 1} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-564636890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44db7b9-3004-46df-975c-65ec9c243140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:23Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Creating volume a44db7b9-3004-46df-975c-65ec9c243140 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:23 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:23 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 1073741824 Nov 05 03:53:23 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Flow 'volume_create_manager' (facde1e9-9bb0-41b0-a009-4e6971af7bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e3ebcf-1ae1-4211-99f6-b33f360f7e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e3ebcf-1ae1-4211-99f6-b33f360f7e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-648938500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379696da-9caf-459d-9e56-f8f61f34c6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922e1d75227b46f0b9501665e69dc34c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:24Z,use_quota=True,user_id='1359baa52b074313bc0b30faee3abddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75bca7d-6389-49e1-be19-e7ca25c17f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75bca7d-6389-49e1-be19-e7ca25c17f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a21176-12a3-4c5d-be57-b70c144c2091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a21176-12a3-4c5d-be57-b70c144c2091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379696da-9caf-459d-9e56-f8f61f34c6e2', 'volume_name': 'volume-379696da-9caf-459d-9e56-f8f61f34c6e2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded86b01-38b7-422b-a405-0ceba5aef193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded86b01-38b7-422b-a405-0ceba5aef193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f723026-853c-477a-9958-26d3bdd57b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:23 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Volume 379696da-9caf-459d-9e56-f8f61f34c6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379696da-9caf-459d-9e56-f8f61f34c6e2', 'volume_size': 1} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:23 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 1073741824" returned: 0 in 0.514s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:23 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 Nov 05 03:53:23 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:24 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.433s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-648938500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379696da-9caf-459d-9e56-f8f61f34c6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922e1d75227b46f0b9501665e69dc34c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:24Z,use_quota=True,user_id='1359baa52b074313bc0b30faee3abddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Creating volume 379696da-9caf-459d-9e56-f8f61f34c6e2 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:24 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:24 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 1073741824 Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb649b1-9b9b-4a86-a187-57275257dc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44db7b9-3004-46df-975c-65ec9c243140', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:24 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d997efe0-5604-498a-8871-2b49c665ea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Volume volume-a44db7b9-3004-46df-975c-65ec9c243140 (a44db7b9-3004-46df-975c-65ec9c243140): created successfully Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d997efe0-5604-498a-8871-2b49c665ea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (c630c414-ec20-406d-a20b-68995fec0b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7a745fbd-9c25-44fd-9f6a-3c1a20d59329 tempest-VolumesActionsTest-2072990577 None] Created volume successfully. Nov 05 03:53:24 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 1073741824" returned: 0 in 0.497s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:24 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 Nov 05 03:53:24 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:24 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2" returned: 0 in 0.250s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f723026-853c-477a-9958-26d3bdd57b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379696da-9caf-459d-9e56-f8f61f34c6e2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b040ff-75dd-449f-a277-5ffb7549f5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:25 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Volume volume-379696da-9caf-459d-9e56-f8f61f34c6e2 (379696da-9caf-459d-9e56-f8f61f34c6e2): created successfully Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b040ff-75dd-449f-a277-5ffb7549f5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Flow 'volume_create_manager' (facde1e9-9bb0-41b0-a009-4e6971af7bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:25 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-d985b5a1-9bff-4065-933e-c2f778473602 req-926f587a-503b-41b9-907d-db4ec483af75 tempest-VolumesSnapshotsTestJSON-2020877981 None] Created volume successfully. Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-a44db7b9-3004-46df-975c-65ec9c243140-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Lock "cinder-a44db7b9-3004-46df-975c-65ec9c243140-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Acquiring lock "cinder-quobyte-a44db7b9-3004-46df-975c-65ec9c243140" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Lock "cinder-quobyte-a44db7b9-3004-46df-975c-65ec9c243140" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2660b777-6a89-4cd8-9166-227f48515dcd]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:25 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 Nov 05 03:53:25 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140" returned: 0 in 0.467s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:26 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140 Nov 05 03:53:26 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Creating offline snapshot 776d449a-3ec4-43b1-992c-501b12a6a1fa of volume 379696da-9caf-459d-9e56-f8f61f34c6e2 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c65ba2-e032-4a9c-a88c-8240918f26e0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:26 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 Nov 05 03:53:26 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a44db7b9-3004-46df-975c-65ec9c243140" returned: 0 in 0.315s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Lock "cinder-quobyte-a44db7b9-3004-46df-975c-65ec9c243140" released by "delete_volume" :: held 0.859s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Created reservations ['26c5cf21-533a-4dc9-bc68-1fa079ed76bf', '7b19f414-cdb4-4433-8306-1a7ac591f7f4', '72b27cc5-0d27-4a92-9cba-f1f67e5809d4', 'ce9fa64d-ad35-4afa-9d4e-26920cb6c812'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:26 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:26 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2" returned: 0 in 0.572s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:26 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa 1G Nov 05 03:53:26 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:26 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Deleted volume successfully. Nov 05 03:53:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2967c3d8-8d06-4c18-a475-d82b971c798f tempest-VolumesActionsTest-1618244594 None] Lock "cinder-a44db7b9-3004-46df-975c-65ec9c243140-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:27 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa 1G" returned: 0 in 0.538s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379696da-9caf-459d-9e56-f8f61f34c6e2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:27 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379696da-9caf-459d-9e56-f8f61f34c6e2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa Nov 05 03:53:27 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (fc91a3e1-f275-4c77-a5e2-40322f14bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eeca99d-a39d-4135-8404-b918468dedd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eeca99d-a39d-4135-8404-b918468dedd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2029370799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc866c3-d979-4d58-8e11-d885dcb73ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:27Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03702ceb-1d9e-4f13-9d5e-45458eb7bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03702ceb-1d9e-4f13-9d5e-45458eb7bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72551bc0-1ad9-41d7-8dbd-1d6d53ba90ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72551bc0-1ad9-41d7-8dbd-1d6d53ba90ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc866c3-d979-4d58-8e11-d885dcb73ce1', 'volume_name': 'volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d612b5c8-976b-4006-b605-2b2db92b588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d612b5c8-976b-4006-b605-2b2db92b588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c2bf49-2531-4b28-9ffc-7231d2202983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:27 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Volume ebc866c3-d979-4d58-8e11-d885dcb73ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1', 'volume_size': 1} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:27 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379696da-9caf-459d-9e56-f8f61f34c6e2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa" returned: 0 in 0.382s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:27 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa is being set with open permissions: ugo+rw Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:27 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa Nov 05 03:53:27 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:27 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa" returned: 0 in 0.242s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:27 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.info Nov 05 03:53:27 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:28 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.info" returned: 0 in 0.268s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:28 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.info is being set with open permissions: ugo+rw Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:28 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.info Nov 05 03:53:28 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:28 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.info" returned: 0 in 0.258s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2029370799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc866c3-d979-4d58-8e11-d885dcb73ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058b625fdd4f43afbb1fedce416bf801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:27Z,use_quota=True,user_id='d1c1dd23d90e45c584e052e9f0491aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Creating volume ebc866c3-d979-4d58-8e11-d885dcb73ce1 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:28 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:28 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 1073741824 Nov 05 03:53:28 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-76da3d76-1e34-4203-b212-371fc5495608 req-1621e466-dd05-43ab-b5e0-57a6122ad934 tempest-VolumesSnapshotsTestJSON-2020877981 None] Create snapshot completed successfully Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "cinder-776d449a-3ec4-43b1-992c-501b12a6a1fa-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-776d449a-3ec4-43b1-992c-501b12a6a1fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "cinder-quobyte-379696da-9caf-459d-9e56-f8f61f34c6e2" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-quobyte-379696da-9caf-459d-9e56-f8f61f34c6e2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "cinder-quobyte-776d449a-3ec4-43b1-992c-501b12a6a1fa" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-quobyte-776d449a-3ec4-43b1-992c-501b12a6a1fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Deleting offline snapshot 776d449a-3ec4-43b1-992c-501b12a6a1fa of volume 379696da-9caf-459d-9e56-f8f61f34c6e2 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] snapshot_file for this snap is: volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff8adc7-b81e-4b04-8022-3a21c0f1aa85]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:28 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa Nov 05 03:53:28 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:29 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 1073741824" returned: 0 in 0.567s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:29 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 Nov 05 03:53:29 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:29 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa" returned: 0 in 0.463s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-379696da-9caf-459d-9e56-f8f61f34c6e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:29 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1" returned: 0 in 0.308s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259cdc4-1c65-4e3a-b2d7-183c3a32cb90]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c2bf49-2531-4b28-9ffc-7231d2202983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8410a8a-654f-42eb-a0c8-39c5ee2c4be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Volume volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 (ebc866c3-d979-4d58-8e11-d885dcb73ce1): created successfully Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8410a8a-654f-42eb-a0c8-39c5ee2c4be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Flow 'volume_create_manager' (fc91a3e1-f275-4c77-a5e2-40322f14bafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-87479e21-5a66-4f94-99fe-13fc95ce16b8 tempest-VolumesActionsTest-2072990577 None] Created volume successfully. Nov 05 03:53:29 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 Nov 05 03:53:29 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:29 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2" returned: 0 in 0.395s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:29 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa Nov 05 03:53:29 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:30 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa" returned: 0 in 0.378s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:30 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa Nov 05 03:53:30 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:30 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2.776d449a-3ec4-43b1-992c-501b12a6a1fa" returned: 0 in 0.275s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-quobyte-776d449a-3ec4-43b1-992c-501b12a6a1fa" released by "_delete_snapshot" :: held 1.693s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-quobyte-379696da-9caf-459d-9e56-f8f61f34c6e2" released by "delete_snapshot" :: held 1.721s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:30 devstack cinder-volume[87111]: DEBUG cinder.quota [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Created reservations ['aa1b7342-061e-46e1-a2ab-3585504ea311', 'e8b4a64d-6b1f-45cf-b9c8-611a2e87019d', 'ebb2770d-2c59-45b7-8ff2-217326352ff2', '518337b5-322b-4770-9c60-fc71d0530232'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Delete snapshot completed successfully. Nov 05 03:53:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-7334d0a9-92ea-4f63-85d1-60374ef9d049 req-eb8162bb-ea2b-49b6-b27c-6bcbe0084d2e tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-776d449a-3ec4-43b1-992c-501b12a6a1fa-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "cinder-379696da-9caf-459d-9e56-f8f61f34c6e2-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-379696da-9caf-459d-9e56-f8f61f34c6e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "cinder-ebc866c3-d979-4d58-8e11-d885dcb73ce1-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-ebc866c3-d979-4d58-8e11-d885dcb73ce1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "cinder-quobyte-379696da-9caf-459d-9e56-f8f61f34c6e2" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-quobyte-379696da-9caf-459d-9e56-f8f61f34c6e2" acquired by "delete_volume" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "cinder-quobyte-ebc866c3-d979-4d58-8e11-d885dcb73ce1" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cef3f14-957a-44c7-953e-9d35e4c22277]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-quobyte-ebc866c3-d979-4d58-8e11-d885dcb73ce1" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc9281-8499-4d8f-b3d2-b2982e228010]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:31 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 Nov 05 03:53:31 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:31 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 Nov 05 03:53:31 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:31 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2" returned: 0 in 0.432s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:31 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2 Nov 05 03:53:31 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:31 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1" returned: 0 in 0.462s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:31 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1 Nov 05 03:53:31 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:32 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-379696da-9caf-459d-9e56-f8f61f34c6e2" returned: 0 in 0.324s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-quobyte-379696da-9caf-459d-9e56-f8f61f34c6e2" released by "delete_volume" :: held 0.915s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:32 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.quota [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Created reservations ['498ac969-eda9-426e-a3d6-53f9b087cb17', 'f857b913-993d-4d84-826c-2e066c1a1ff5', 'c6947fad-d1aa-4cd6-a6fd-0db742124532', 'eb5e464e-3986-4d01-bcc3-08217f35ef0e'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ebc866c3-d979-4d58-8e11-d885dcb73ce1" returned: 0 in 0.394s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-quobyte-ebc866c3-d979-4d58-8e11-d885dcb73ce1" released by "delete_volume" :: held 0.938s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Created reservations ['a389515b-d911-4c6a-8102-a020d25b8675', 'a97ad937-dc43-4010-bdb1-86b5b346f06a', '7d87d4d0-47d9-42a3-9ec0-4ccc41612dd3', '46843a47-3846-41a6-83fe-2e91c1e0074b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:32 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:32 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:32 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:32 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:32 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.manager [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Deleted volume successfully. Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-14756f4c-218a-4bc8-ae5d-4c9657df4853 req-6e141a22-0177-4daf-953f-e852d651c698 tempest-VolumesSnapshotsTestJSON-2020877981 None] Lock "cinder-379696da-9caf-459d-9e56-f8f61f34c6e2-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:32 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Deleted volume successfully. Nov 05 03:53:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3ae64071-eeed-49c1-925b-d39c7edbc161 tempest-VolumesActionsTest-2072990577 None] Lock "cinder-ebc866c3-d979-4d58-8e11-d885dcb73ce1-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:42 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=156,cinder:UPDATE=174,cinder:DELETE=18,cinder:INSERT=41 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:53:42 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=181,cinder:INSERT=46,cinder:SELECT=148,cinder:DELETE=10 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:53:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7daf55b6-227d-4dd3-b9e5-1388bcd3f543 tempest-GroupsTest-1477055178 None] Group tempest-Group1-575297531: creating Nov 05 03:53:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7daf55b6-227d-4dd3-b9e5-1388bcd3f543 tempest-GroupsTest-1477055178 None] Group tempest-Group1-575297531: created successfully Nov 05 03:53:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7daf55b6-227d-4dd3-b9e5-1388bcd3f543 tempest-GroupsTest-1477055178 None] Create group completed successfully. Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Flow 'volume_create_manager' (d30a200b-2ca8-4293-bf22-1a2a7492e50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00e5c1e-d050-4f47-9845-5e6dfd1d8efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00e5c1e-d050-4f47-9845-5e6dfd1d8efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-24028883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa85dc88-d906-45d6-bb5d-ddd14e0e392a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08adc2ced8ff435fb864c2b7e382cd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:52Z,use_quota=True,user_id='67eb5c5f018b4aca9ce353d2664effd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d94027-3cc0-4168-a132-1b42a0e1dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d94027-3cc0-4168-a132-1b42a0e1dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1734acdf-fc1f-4d27-9a1e-c822644108a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1734acdf-fc1f-4d27-9a1e-c822644108a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa85dc88-d906-45d6-bb5d-ddd14e0e392a', 'volume_name': 'volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330c90d8-8776-4c62-9fdd-772e7b9c6d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330c90d8-8776-4c62-9fdd-772e7b9c6d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80743ceb-3d1f-4335-95e1-3d199938f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Volume aa85dc88-d906-45d6-bb5d-ddd14e0e392a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a', 'volume_size': 1} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-24028883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa85dc88-d906-45d6-bb5d-ddd14e0e392a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08adc2ced8ff435fb864c2b7e382cd6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:52Z,use_quota=True,user_id='67eb5c5f018b4aca9ce353d2664effd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Creating volume aa85dc88-d906-45d6-bb5d-ddd14e0e392a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:52 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:52 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a 1073741824 Nov 05 03:53:52 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-983ffbbb-774b-4a08-a154-e50cb61310c6 tempest-GroupsTest-1477055178 None] Group tempest-Group2-1487652464: creating Nov 05 03:53:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-983ffbbb-774b-4a08-a154-e50cb61310c6 tempest-GroupsTest-1477055178 None] Group tempest-Group2-1487652464: created successfully Nov 05 03:53:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-983ffbbb-774b-4a08-a154-e50cb61310c6 tempest-GroupsTest-1477055178 None] Create group completed successfully. Nov 05 03:53:52 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a 1073741824" returned: 0 in 0.510s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:52 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a Nov 05 03:53:52 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:52 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" returned: 0 in 0.250s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80743ceb-3d1f-4335-95e1-3d199938f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ac2db0-0248-4fb6-acd3-96132e5b97fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:53 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Volume volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a (aa85dc88-d906-45d6-bb5d-ddd14e0e392a): created successfully Nov 05 03:53:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ac2db0-0248-4fb6-acd3-96132e5b97fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Flow 'volume_create_manager' (d30a200b-2ca8-4293-bf22-1a2a7492e50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c8cb020f-e790-4ae2-bb63-9d08d658e1aa tempest-SnapshotMetadataTestJSON-1501391758 None] Created volume successfully. Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Flow 'volume_create_manager' (95805f4a-66db-4fbc-9cc5-4d950a75aea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd18d5ab-ffe1-48a4-8667-708dc559acf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd18d5ab-ffe1-48a4-8667-708dc559acf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1580538652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=544bd0f7-8430-4852-b80c-983629353076,host='devstack@QuobyteHD#QuobyteHD',id=53d84dd3-76c1-477a-90ee-3a87862a1a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fb88eaec44080acac33a5c281ec2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:54Z,use_quota=True,user_id='03191582b642429fbacf68242db8deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27429392-cb32-4a17-bae3-93b5a8d1d2a0),volume_type_id=27429392-cb32-4a17-bae3-93b5a8d1d2a0)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2182d7c-60ff-48dd-b825-043c1d475762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2182d7c-60ff-48dd-b825-043c1d475762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2f2476-22fa-49cf-a7b7-77ac94de9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2f2476-22fa-49cf-a7b7-77ac94de9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d84dd3-76c1-477a-90ee-3a87862a1a86', 'volume_name': 'volume-53d84dd3-76c1-477a-90ee-3a87862a1a86', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65a9af4-568f-426a-97da-a75272f58761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65a9af4-568f-426a-97da-a75272f58761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91b6c52-ddcd-4530-9ca6-e74ffa2ed963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Volume 53d84dd3-76c1-477a-90ee-3a87862a1a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d84dd3-76c1-477a-90ee-3a87862a1a86', 'volume_size': 1} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=544bd0f7-8430-4852-b80c-983629353076,created_at=2026-11-05T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1580538652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=544bd0f7-8430-4852-b80c-983629353076,host='devstack@QuobyteHD#QuobyteHD',id=53d84dd3-76c1-477a-90ee-3a87862a1a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fb88eaec44080acac33a5c281ec2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:54Z,use_quota=True,user_id='03191582b642429fbacf68242db8deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27429392-cb32-4a17-bae3-93b5a8d1d2a0),volume_type_id=27429392-cb32-4a17-bae3-93b5a8d1d2a0)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Creating volume 53d84dd3-76c1-477a-90ee-3a87862a1a86 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:54 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:54 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 1073741824 Nov 05 03:53:54 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Flow 'volume_create_manager' (dc91bf15-379b-4187-b180-89a362c5634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3504fc81-d784-46ca-ac47-301332458fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3504fc81-d784-46ca-ac47-301332458fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1107690601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271f6f97-ca10-4601-8c90-7d8220500b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d97ba3c5e934c05aa876cac1cfea890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:55Z,use_quota=True,user_id='6568cceb48dd406f9a1af1adcf99dd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59afdc3c-700c-4d6e-8dec-fe462b48b47c),volume_type_id=59afdc3c-700c-4d6e-8dec-fe462b48b47c)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b365ff-8ce0-4a8e-b128-2f53e30bd978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b365ff-8ce0-4a8e-b128-2f53e30bd978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71466d8e-1417-468a-804e-720c3882c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71466d8e-1417-468a-804e-720c3882c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271f6f97-ca10-4601-8c90-7d8220500b49', 'volume_name': 'volume-271f6f97-ca10-4601-8c90-7d8220500b49', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a31650a-a46d-4d93-81c2-6d37d0cf3d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a31650a-a46d-4d93-81c2-6d37d0cf3d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a67e58-b018-4bf8-bc7f-95fd3210b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Volume 271f6f97-ca10-4601-8c90-7d8220500b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271f6f97-ca10-4601-8c90-7d8220500b49', 'volume_size': 1} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:54 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 1073741824" returned: 0 in 0.611s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:55 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 Nov 05 03:53:55 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Flow 'volume_create_manager' (05d1e95f-f61a-4322-87db-7d0fc1376460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1198fd9d-3e64-48e8-af9c-699cbb0b57c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1198fd9d-3e64-48e8-af9c-699cbb0b57c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2124586740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e212830-0632-4cc9-a490-2e75890d6021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d97ba3c5e934c05aa876cac1cfea890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:55Z,use_quota=True,user_id='6568cceb48dd406f9a1af1adcf99dd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44552c98-fade-44c4-b868-99d0511391b8),volume_type_id=44552c98-fade-44c4-b868-99d0511391b8)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aab4454-50b0-407f-b727-26dc0c75ec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aab4454-50b0-407f-b727-26dc0c75ec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dbd07c-3689-4869-affc-6c84fbed28a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dbd07c-3689-4869-affc-6c84fbed28a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e212830-0632-4cc9-a490-2e75890d6021', 'volume_name': 'volume-7e212830-0632-4cc9-a490-2e75890d6021', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dad84b6-07e5-466c-9814-f15e69afd813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dad84b6-07e5-466c-9814-f15e69afd813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41877cb6-3028-45c8-a7c9-de63614bc468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Volume 7e212830-0632-4cc9-a490-2e75890d6021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e212830-0632-4cc9-a490-2e75890d6021', 'volume_size': 1} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1107690601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271f6f97-ca10-4601-8c90-7d8220500b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d97ba3c5e934c05aa876cac1cfea890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:55Z,use_quota=True,user_id='6568cceb48dd406f9a1af1adcf99dd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59afdc3c-700c-4d6e-8dec-fe462b48b47c),volume_type_id=59afdc3c-700c-4d6e-8dec-fe462b48b47c)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Creating volume 271f6f97-ca10-4601-8c90-7d8220500b49 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:55 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91b6c52-ddcd-4530-9ca6-e74ffa2ed963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d84dd3-76c1-477a-90ee-3a87862a1a86', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eb6876-eb26-4bc1-8dc5-e75550363ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 1073741824 Nov 05 03:53:55 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:55 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Volume volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 (53d84dd3-76c1-477a-90ee-3a87862a1a86): created successfully Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eb6876-eb26-4bc1-8dc5-e75550363ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Flow 'volume_create_manager' (95805f4a-66db-4fbc-9cc5-4d950a75aea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e96360ab-4c08-4466-a8a0-7995d889bb9c tempest-GroupsTest-1477055178 None] Created volume successfully. Nov 05 03:53:55 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 1073741824" returned: 0 in 0.585s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:56 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 Nov 05 03:53:56 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Flow 'volume_create_manager' (b7a38292-2c0e-4333-a9ae-69f438dc8877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205358c6-c145-40cc-bc85-e0ea5d0da794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205358c6-c145-40cc-bc85-e0ea5d0da794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-5997527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318d927a-deda-4221-9db4-3767f5e76fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d97ba3c5e934c05aa876cac1cfea890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:56Z,use_quota=True,user_id='6568cceb48dd406f9a1af1adcf99dd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9f9b40-c94b-4080-86c2-ccaf0708dd1e),volume_type_id=aa9f9b40-c94b-4080-86c2-ccaf0708dd1e)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb0d3c0-428e-4d83-8fe7-7e49f5c1658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb0d3c0-428e-4d83-8fe7-7e49f5c1658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fbac66-3133-411a-963c-5ebae613599b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:53:56 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49" returned: 0 in 0.252s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.340s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a67e58-b018-4bf8-bc7f-95fd3210b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271f6f97-ca10-4601-8c90-7d8220500b49', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ac408a-e882-4d9c-b0e9-d4a9f52f736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Creating offline snapshot 09040883-6479-49d0-8818-e021c3bac11a of volume aa85dc88-d906-45d6-bb5d-ddd14e0e392a {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:56 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Volume volume-271f6f97-ca10-4601-8c90-7d8220500b49 (271f6f97-ca10-4601-8c90-7d8220500b49): created successfully Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ac408a-e882-4d9c-b0e9-d4a9f52f736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Flow 'volume_create_manager' (dc91bf15-379b-4187-b180-89a362c5634b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc06cddb-7d10-4496-8810-1b743e1f0ec7]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e72cbfcc-9091-4327-aeea-26c39b0edcc7 tempest-TestInstancesWithCinderVolumes-328084730 None] Created volume successfully. Nov 05 03:53:56 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a Nov 05 03:53:56 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fbac66-3133-411a-963c-5ebae613599b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '318d927a-deda-4221-9db4-3767f5e76fa5', 'volume_name': 'volume-318d927a-deda-4221-9db4-3767f5e76fa5', 'volume_size': 1, 'image_id': '79f6729c-85e0-42e9-af84-9139dbb9b51e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79f6729c-85e0-42e9-af84-9139dbb9b51e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1135425493', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d97ba3c5e934c05aa876cac1cfea890', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79f6729c-85e0-42e9-af84-9139dbb9b51e', 'created_at': datetime.datetime(2026, 11, 5, 2, 53, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79f6729c-85e0-42e9-af84-9139dbb9b51e/file', 'properties': {}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a96212d-a292-4496-92ba-bb061b9b6cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a96212d-a292-4496-92ba-bb061b9b6cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9f684e-247a-4362-b648-4a320bae00df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Volume 318d927a-deda-4221-9db4-3767f5e76fa5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-318d927a-deda-4221-9db4-3767f5e76fa5', 'volume_size': 1, 'image_id': '79f6729c-85e0-42e9-af84-9139dbb9b51e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79f6729c-85e0-42e9-af84-9139dbb9b51e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1135425493', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d97ba3c5e934c05aa876cac1cfea890', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79f6729c-85e0-42e9-af84-9139dbb9b51e', 'created_at': datetime.datetime(2026, 11, 5, 2, 53, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79f6729c-85e0-42e9-af84-9139dbb9b51e/file', 'properties': {}}, 'image_service': } Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Trying to clone 318d927a-deda-4221-9db4-3767f5e76fa5 from image 79f6729c-85e0-42e9-af84-9139dbb9b51e at location (None, [{'url': 'file:///opt/stack/data/glance/images/79f6729c-85e0-42e9-af84-9139dbb9b51e', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:53:56 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" returned: 0 in 0.392s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:56 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a 1G Nov 05 03:53:56 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:57 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a 1G" returned: 0 in 0.488s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:57 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a Nov 05 03:53:57 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Acquiring lock "cinder-quobyte-53d84dd3-76c1-477a-90ee-3a87862a1a86" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:57 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a" returned: 0 in 0.370s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:57 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a is being set with open permissions: ugo+rw Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Lock "cinder-quobyte-53d84dd3-76c1-477a-90ee-3a87862a1a86" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:57 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a Nov 05 03:53:57 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[214cfa2e-d74d-413f-9674-75604946c7d3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:57 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 Nov 05 03:53:57 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:57 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:57 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.info Nov 05 03:53:57 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:58 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86" returned: 0 in 0.425s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:58 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86 Nov 05 03:53:58 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:58 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.info" returned: 0 in 0.300s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:58 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.info is being set with open permissions: ugo+rw Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:58 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.info Nov 05 03:53:58 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:58 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-53d84dd3-76c1-477a-90ee-3a87862a1a86" returned: 0 in 0.303s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Lock "cinder-quobyte-53d84dd3-76c1-477a-90ee-3a87862a1a86" released by "delete_volume" :: held 0.785s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Created reservations ['29f20eaf-e572-4c96-a049-36349cf313f7'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:58 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.info" returned: 0 in 0.272s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.160s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2124586740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e212830-0632-4cc9-a490-2e75890d6021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d97ba3c5e934c05aa876cac1cfea890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:55Z,use_quota=True,user_id='6568cceb48dd406f9a1af1adcf99dd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44552c98-fade-44c4-b868-99d0511391b8),volume_type_id=44552c98-fade-44c4-b868-99d0511391b8)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Creating volume 7e212830-0632-4cc9-a490-2e75890d6021 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:58 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:58 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 1073741824 Nov 05 03:53:58 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:58 devstack cinder-volume[87111]: WARNING cinder.quota [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-951853415 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-951853415, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:53:58 devstack cinder-volume[87111]: WARNING cinder.quota [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-951853415 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-951853415, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:53:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b149363c-b507-4eb6-bdfc-98c2bb080df8 tempest-SnapshotMetadataTestJSON-1501391758 None] Create snapshot completed successfully Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Created reservations ['3c895229-4d1c-41e5-82fa-3143f9aa8870', '5031826c-defb-41bc-8a66-d7f6beebe754', '46d06839-01e7-45e7-ac1c-85ee4f63d171', 'c8b80109-8c07-4425-b8c2-8b892ba16243'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:58 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:53:58 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:59 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-74867177-d436-4525-8540-9c9433dd75a3 tempest-GroupsTest-1477055178 None] Delete group completed successfully. Nov 05 03:53:59 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 1073741824" returned: 0 in 0.564s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:59 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 Nov 05 03:53:59 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:59 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021" returned: 0 in 0.268s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41877cb6-3028-45c8-a7c9-de63614bc468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e212830-0632-4cc9-a490-2e75890d6021', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fff297-e370-4a8d-b0b0-953fa56b14b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Volume volume-7e212830-0632-4cc9-a490-2e75890d6021 (7e212830-0632-4cc9-a490-2e75890d6021): created successfully Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fff297-e370-4a8d-b0b0-953fa56b14b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Flow 'volume_create_manager' (05d1e95f-f61a-4322-87db-7d0fc1376460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-490aab08-bcbe-40a5-9d5a-9522ea876bee tempest-TestInstancesWithCinderVolumes-328084730 None] Created volume successfully. Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "cinder-09040883-6479-49d0-8818-e021c3bac11a-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-09040883-6479-49d0-8818-e021c3bac11a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "cinder-quobyte-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-quobyte-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "cinder-quobyte-09040883-6479-49d0-8818-e021c3bac11a" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-quobyte-09040883-6479-49d0-8818-e021c3bac11a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Deleting offline snapshot 09040883-6479-49d0-8818-e021c3bac11a of volume aa85dc88-d906-45d6-bb5d-ddd14e0e392a {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] snapshot_file for this snap is: volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa79c4d4-31b3-4587-9a78-49153bab10e5]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:59 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Created reservations ['1ddcf990-1d13-4ba5-8eb8-77efa1d22a08'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:59 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a Nov 05 03:53:59 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:00 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:54:00 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:00 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a" returned: 0 in 0.419s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3c1b27-0260-461d-81fe-828bfb07215b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:00 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.312s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:00 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-aa251f95-19bd-4002-8ea1-716f316f80ac tempest-GroupsTest-1477055178 None] Delete group completed successfully. Nov 05 03:54:00 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a Nov 05 03:54:00 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:00 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" returned: 0 in 0.426s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:00 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a Nov 05 03:54:00 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD, size 20.69 MB, duration 4.33 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:54:00 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Image download 20.69 MB at 4.78 MB/s Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe5cb6-7220-4b0d-98fd-415411fd5343]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:01 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD Nov 05 03:54:01 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:01 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a" returned: 0 in 0.413s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:01 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a Nov 05 03:54:01 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:01 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Temporary image 79f6729c-85e0-42e9-af84-9139dbb9b51e is fetched for user 6568cceb48dd406f9a1af1adcf99dd9a. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae917b4-ff93-4905-a59a-fb47e53a4403]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:01 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a.09040883-6479-49d0-8818-e021c3bac11a" returned: 0 in 0.309s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:01 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD Nov 05 03:54:01 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-quobyte-09040883-6479-49d0-8818-e021c3bac11a" released by "_delete_snapshot" :: held 1.717s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-quobyte-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" released by "delete_snapshot" :: held 1.748s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Created reservations ['05a03269-bc4a-4d4b-8b1a-16925ca360cc', 'dbbff8ae-07c9-4852-b046-a9f08de9e4a5', '2a8e4179-b8ea-4b72-94d1-1acc2312c653', '46ac083b-c597-4525-91bb-cd9f5a0a12d9'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7aa7034c-2f7e-4c7b-99c8-272ae8ccb9f9 tempest-GroupsTest-1477055178 None] Group tempest-GroupsTest-Group-1696834525: creating Nov 05 03:54:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7aa7034c-2f7e-4c7b-99c8-272ae8ccb9f9 tempest-GroupsTest-1477055178 None] Group tempest-GroupsTest-Group-1696834525: created successfully Nov 05 03:54:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7aa7034c-2f7e-4c7b-99c8-272ae8ccb9f9 tempest-GroupsTest-1477055178 None] Create group completed successfully. Nov 05 03:54:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Delete snapshot completed successfully. Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d3a341fe-8936-428d-bca9-4d017e10a650 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-09040883-6479-49d0-8818-e021c3bac11a-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:01 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-5997527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318d927a-deda-4221-9db4-3767f5e76fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d97ba3c5e934c05aa876cac1cfea890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:56Z,use_quota=True,user_id='6568cceb48dd406f9a1af1adcf99dd9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9f9b40-c94b-4080-86c2-ccaf0708dd1e),volume_type_id=aa9f9b40-c94b-4080-86c2-ccaf0708dd1e)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Creating volume 318d927a-deda-4221-9db4-3767f5e76fa5 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:01 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:01 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 1073741824 Nov 05 03:54:01 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "cinder-aa85dc88-d906-45d6-bb5d-ddd14e0e392a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-aa85dc88-d906-45d6-bb5d-ddd14e0e392a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "cinder-quobyte-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-quobyte-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffef40ee-5006-46a1-b495-b9595d298f40]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:02 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a Nov 05 03:54:02 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:02 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 1073741824" returned: 0 in 0.500s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:02 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 Nov 05 03:54:02 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:02 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" returned: 0 in 0.409s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:02 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a Nov 05 03:54:02 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:02 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Attempting download of 79f6729c-85e0-42e9-af84-9139dbb9b51e ((None, [{'url': 'file:///opt/stack/data/glance/images/79f6729c-85e0-42e9-af84-9139dbb9b51e', 'metadata': {}}])) to volume 318d927a-deda-4221-9db4-3767f5e76fa5. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4094eecc-1354-4838-b7d2-2561d4e2907e]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79f6729c-85e0-42e9-af84-9139dbb9b51e_tefvo_5q {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:02 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" returned: 0 in 0.291s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-quobyte-aa85dc88-d906-45d6-bb5d-ddd14e0e392a" released by "delete_volume" :: held 0.778s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:02 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79f6729c-85e0-42e9-af84-9139dbb9b51e_tefvo_5q Nov 05 03:54:02 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:02 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Created reservations ['5f75ac42-34ab-4afe-ab53-6be34c9d2e0d', '2e670a16-1f81-46b4-975f-87db755785cb', '50e13adf-0d1e-4eb6-ae67-3589f64346b1', '870b9248-a775-4460-90b3-69222961cd0c'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:03 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:54:03 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:03 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79f6729c-85e0-42e9-af84-9139dbb9b51e_tefvo_5q" returned: 0 in 0.451s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79f6729c-85e0-42e9-af84-9139dbb9b51e_tefvo_5q {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:03 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.413s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:03 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Deleted volume successfully. Nov 05 03:54:03 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79f6729c-85e0-42e9-af84-9139dbb9b51e_tefvo_5q Nov 05 03:54:03 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5e2a092d-e108-49e3-8938-04f71f6b6133 tempest-SnapshotMetadataTestJSON-1501391758 None] Lock "cinder-aa85dc88-d906-45d6-bb5d-ddd14e0e392a-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Flow 'volume_create_manager' (80e44185-49e6-4b44-bb17-eb35c4f4d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ea1142-af76-4580-9475-781485ed8290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ea1142-af76-4580-9475-781485ed8290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-871446303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9227f96-c7ee-4036-9771-7f2a2e75da8a,host='devstack@QuobyteHD#QuobyteHD',id=1a090c39-2379-4256-a929-822258fd0b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fb88eaec44080acac33a5c281ec2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:03Z,use_quota=True,user_id='03191582b642429fbacf68242db8deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34eca319-ccd3-4f8d-8ce9-2f5001518396),volume_type_id=34eca319-ccd3-4f8d-8ce9-2f5001518396)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a85baa8-05ff-4930-b085-916963fc677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a85baa8-05ff-4930-b085-916963fc677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1be1f5-ec75-4566-90a3-49c05b558959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1be1f5-ec75-4566-90a3-49c05b558959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a090c39-2379-4256-a929-822258fd0b64', 'volume_name': 'volume-1a090c39-2379-4256-a929-822258fd0b64', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477c0a3d-319c-446c-a5d9-d353c947c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477c0a3d-319c-446c-a5d9-d353c947c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f79eb87-cb6d-4f0a-9c01-480e1434b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Volume 1a090c39-2379-4256-a929-822258fd0b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a090c39-2379-4256-a929-822258fd0b64', 'volume_size': 1} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9227f96-c7ee-4036-9771-7f2a2e75da8a,created_at=2026-11-05T02:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-871446303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9227f96-c7ee-4036-9771-7f2a2e75da8a,host='devstack@QuobyteHD#QuobyteHD',id=1a090c39-2379-4256-a929-822258fd0b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fb88eaec44080acac33a5c281ec2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:03Z,use_quota=True,user_id='03191582b642429fbacf68242db8deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34eca319-ccd3-4f8d-8ce9-2f5001518396),volume_type_id=34eca319-ccd3-4f8d-8ce9-2f5001518396)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Creating volume 1a090c39-2379-4256-a929-822258fd0b64 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:03 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:03 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 1073741824 Nov 05 03:54:03 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:03 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79f6729c-85e0-42e9-af84-9139dbb9b51e_tefvo_5q" returned: 1 in 0.526s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79f6729c-85e0-42e9-af84-9139dbb9b51e_tefvo_5q' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea4e6f7-f7aa-4769-aaa7-f54e299722f4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:03 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD Nov 05 03:54:03 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:04 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] 79f6729c-85e0-42e9-af84-9139dbb9b51e was qcow2, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:04 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 Nov 05 03:54:04 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:04 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 1073741824" returned: 0 in 0.539s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:04 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 Nov 05 03:54:04 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:04 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64" returned: 0 in 0.407s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f79eb87-cb6d-4f0a-9c01-480e1434b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a090c39-2379-4256-a929-822258fd0b64', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eaef984-3dd9-4f03-8630-400f95b6b4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Volume volume-1a090c39-2379-4256-a929-822258fd0b64 (1a090c39-2379-4256-a929-822258fd0b64): created successfully Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eaef984-3dd9-4f03-8630-400f95b6b4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Flow 'volume_create_manager' (80e44185-49e6-4b44-bb17-eb35c4f4d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e1be5287-44bd-4f40-8762-f01c324d5b5d tempest-GroupsTest-1477055178 None] Created volume successfully. Nov 05 03:54:06 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5" returned: 0 in 2.474s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:06 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79f6729c-85e0-42e9-af84-9139dbb9b51e_sc3ea4_ddevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:54:06 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Converted 112.00 MB image at 45.20 MB/s Nov 05 03:54:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:06 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 1G Nov 05 03:54:06 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:06 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Flow 'volume_create_manager' (1cc4641a-2a7d-4fdd-a111-6fc9b019fd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e77b8b-b685-4db4-a918-3b43ff6ea3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e77b8b-b685-4db4-a918-3b43ff6ea3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1853537990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9227f96-c7ee-4036-9771-7f2a2e75da8a,host='devstack@QuobyteHD#QuobyteHD',id=d6ef0a4f-907a-417f-bc25-8b2da53f23a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fb88eaec44080acac33a5c281ec2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:07Z,use_quota=True,user_id='03191582b642429fbacf68242db8deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34eca319-ccd3-4f8d-8ce9-2f5001518396),volume_type_id=34eca319-ccd3-4f8d-8ce9-2f5001518396)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89995aa-a8ef-458e-960a-a0e32fad60c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89995aa-a8ef-458e-960a-a0e32fad60c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26c4549-75e9-4c2f-94e1-f59193772636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26c4549-75e9-4c2f-94e1-f59193772636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ef0a4f-907a-417f-bc25-8b2da53f23a8', 'volume_name': 'volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d02decd-5821-4411-82b5-a072262f5942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d02decd-5821-4411-82b5-a072262f5942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151bc7c7-3d1e-4ba8-81d5-31c8f1b4258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:07 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Volume d6ef0a4f-907a-417f-bc25-8b2da53f23a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8', 'volume_size': 1} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9227f96-c7ee-4036-9771-7f2a2e75da8a,created_at=2026-11-05T02:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1853537990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9227f96-c7ee-4036-9771-7f2a2e75da8a,host='devstack@QuobyteHD#QuobyteHD',id=d6ef0a4f-907a-417f-bc25-8b2da53f23a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52fb88eaec44080acac33a5c281ec2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:07Z,use_quota=True,user_id='03191582b642429fbacf68242db8deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34eca319-ccd3-4f8d-8ce9-2f5001518396),volume_type_id=34eca319-ccd3-4f8d-8ce9-2f5001518396)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Creating volume d6ef0a4f-907a-417f-bc25-8b2da53f23a8 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:07 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:07 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 1073741824 Nov 05 03:54:07 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:07 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 1G" returned: 0 in 0.488s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Downloaded image 79f6729c-85e0-42e9-af84-9139dbb9b51e ((None, [{'url': 'file:///opt/stack/data/glance/images/79f6729c-85e0-42e9-af84-9139dbb9b51e', 'metadata': {}}])) to volume 318d927a-deda-4221-9db4-3767f5e76fa5 successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Temporary image 79f6729c-85e0-42e9-af84-9139dbb9b51e for user 6568cceb48dd406f9a1af1adcf99dd9a is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Marking volume 318d927a-deda-4221-9db4-3767f5e76fa5 as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Copying metadata from image 79f6729c-85e0-42e9-af84-9139dbb9b51e to 318d927a-deda-4221-9db4-3767f5e76fa5. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Creating volume glance metadata for volume 318d927a-deda-4221-9db4-3767f5e76fa5 backed by image 79f6729c-85e0-42e9-af84-9139dbb9b51e with: {'image_id': '79f6729c-85e0-42e9-af84-9139dbb9b51e', 'image_name': 'tempest-scenario-img--1135425493', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9f684e-247a-4362-b648-4a320bae00df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318d927a-deda-4221-9db4-3767f5e76fa5', 'volume_size': 1, 'image_id': '79f6729c-85e0-42e9-af84-9139dbb9b51e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79f6729c-85e0-42e9-af84-9139dbb9b51e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1135425493', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d97ba3c5e934c05aa876cac1cfea890', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79f6729c-85e0-42e9-af84-9139dbb9b51e', 'created_at': datetime.datetime(2026, 11, 5, 2, 53, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 53, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79f6729c-85e0-42e9-af84-9139dbb9b51e/file', 'properties': {}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8658c4-e657-4a86-96e8-605b2db9f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:07 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Volume volume-318d927a-deda-4221-9db4-3767f5e76fa5 (318d927a-deda-4221-9db4-3767f5e76fa5): created successfully Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8658c4-e657-4a86-96e8-605b2db9f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Flow 'volume_create_manager' (b7a38292-2c0e-4333-a9ae-69f438dc8877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:07 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-722c30a2-352c-45e8-b0d1-6b1795d561aa tempest-TestInstancesWithCinderVolumes-328084730 None] Created volume successfully. Nov 05 03:54:07 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 1073741824" returned: 0 in 0.629s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:07 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 Nov 05 03:54:07 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:08 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8" returned: 0 in 0.367s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151bc7c7-3d1e-4ba8-81d5-31c8f1b4258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5647ba1-6c2b-4640-a1f3-dc536cf328fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:08 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Volume volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 (d6ef0a4f-907a-417f-bc25-8b2da53f23a8): created successfully Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5647ba1-6c2b-4640-a1f3-dc536cf328fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Flow 'volume_create_manager' (1cc4641a-2a7d-4fdd-a111-6fc9b019fd56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:08 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-1a7049c9-b877-4c71-8931-208c41404ddb tempest-GroupsTest-1477055178 None] Created volume successfully. Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Flow 'volume_create_manager' (6b41e82d-6531-40d7-84c4-51feb1a23c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e2ecad-d360-4044-8d46-7e2c4e7ac5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e2ecad-d360-4044-8d46-7e2c4e7ac5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-151651929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a85c7e-6b94-480b-a212-cd722614b50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ad65fc420f4bf595c2b85b5cef23dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:08Z,use_quota=True,user_id='f051555f1be14a93bfe0a01cc6ced822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f029d045-c590-42f4-a70d-fef55ee28602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f029d045-c590-42f4-a70d-fef55ee28602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2020c21a-134c-4329-8ad2-cc4817423517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2020c21a-134c-4329-8ad2-cc4817423517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a85c7e-6b94-480b-a212-cd722614b50b', 'volume_name': 'volume-f2a85c7e-6b94-480b-a212-cd722614b50b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c554814-5733-4f73-88de-9cb1053e2364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c554814-5733-4f73-88de-9cb1053e2364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7167336-5894-4c50-98af-c74c371674d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:08 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Volume f2a85c7e-6b94-480b-a212-cd722614b50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a85c7e-6b94-480b-a212-cd722614b50b', 'volume_size': 1} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-151651929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a85c7e-6b94-480b-a212-cd722614b50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ad65fc420f4bf595c2b85b5cef23dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:08Z,use_quota=True,user_id='f051555f1be14a93bfe0a01cc6ced822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Creating volume f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:08 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:54:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:08 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b 1073741824 Nov 05 03:54:08 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:09 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b 1073741824" returned: 0 in 0.528s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:09 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b Nov 05 03:54:09 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:09 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b" returned: 0 in 0.317s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7167336-5894-4c50-98af-c74c371674d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a85c7e-6b94-480b-a212-cd722614b50b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a84173f-85be-485e-86cc-617eddd44168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:09 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Volume volume-f2a85c7e-6b94-480b-a212-cd722614b50b (f2a85c7e-6b94-480b-a212-cd722614b50b): created successfully Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a84173f-85be-485e-86cc-617eddd44168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Flow 'volume_create_manager' (6b41e82d-6531-40d7-84c4-51feb1a23c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:09 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6ffe2878-4091-4c92-aa30-cb3cf95a32c5 tempest-VolumesDeleteCascade-1033681115 None] Created volume successfully. Nov 05 03:54:09 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-57f477ce-189d-4f4a-b669-4fbd43610395 tempest-GroupsTest-1477055178 None] Update group completed successfully. Nov 05 03:54:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Creating offline snapshot 2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 of volume f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:54:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d48493-19c0-43d6-8c48-8edf682aa2ce]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-66dd2d62-7133-4900-a54e-4845f8d49a41 tempest-GroupsTest-1477055178 None] Update group completed successfully. Nov 05 03:54:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ad954532-068d-4b8e-a6d6-feb412e37841 req-8a3c349a-ebfb-496a-b9f3-f70eee1bc6f7 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:11 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b Nov 05 03:54:11 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:11 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b" returned: 0 in 0.453s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:11 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 1G Nov 05 03:54:11 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 1G" returned: 0 in 0.447s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:12 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 Nov 05 03:54:12 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" returned: 0 in 0.346s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:12 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 is being set with open permissions: ugo+rw Nov 05 03:54:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:12 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 Nov 05 03:54:12 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" returned: 0 in 0.293s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:12 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.info Nov 05 03:54:12 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Acquiring lock "cinder-quobyte-1a090c39-2379-4256-a929-822258fd0b64" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Lock "cinder-quobyte-1a090c39-2379-4256-a929-822258fd0b64" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:13 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.info" returned: 0 in 0.328s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.info is being set with open permissions: ugo+rw Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f172175-2f35-416e-820b-6434326f1523]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:13 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.info Nov 05 03:54:13 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:13 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 Nov 05 03:54:13 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:13 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.info" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ad954532-068d-4b8e-a6d6-feb412e37841 req-8a3c349a-ebfb-496a-b9f3-f70eee1bc6f7 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.175s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ad954532-068d-4b8e-a6d6-feb412e37841 req-8a3c349a-ebfb-496a-b9f3-f70eee1bc6f7 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-81a11eca-cd46-460f-b5e9-556f2f7a904e tempest-VolumesDeleteCascade-1033681115 None] Create snapshot completed successfully Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-ad954532-068d-4b8e-a6d6-feb412e37841 req-8a3c349a-ebfb-496a-b9f3-f70eee1bc6f7 tempest-TestInstancesWithCinderVolumes-328084730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-318d927a-deda-4221-9db4-3767f5e76fa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5648356-25d5-462a-a38d-60d7fac3df80', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:54:13 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-ad954532-068d-4b8e-a6d6-feb412e37841 req-8a3c349a-ebfb-496a-b9f3-f70eee1bc6f7 tempest-TestInstancesWithCinderVolumes-328084730 None] attachment_update completed successfully. Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64" returned: 0 in 0.520s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:13 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64 Nov 05 03:54:13 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:13 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1a090c39-2379-4256-a929-822258fd0b64" returned: 0 in 0.295s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Lock "cinder-quobyte-1a090c39-2379-4256-a929-822258fd0b64" released by "delete_volume" :: held 0.882s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Acquiring lock "cinder-quobyte-d6ef0a4f-907a-417f-bc25-8b2da53f23a8" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Lock "cinder-quobyte-d6ef0a4f-907a-417f-bc25-8b2da53f23a8" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed9d34b-5bf5-4cd1-ae38-e13060b2febc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:14 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 Nov 05 03:54:14 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:14 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8" returned: 0 in 0.690s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:14 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8 Nov 05 03:54:14 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Creating offline snapshot 7cdf97cf-df03-49e8-bacd-0c32476bc158 of volume f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:54:14 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9019fde-fb55-48b5-8874-4bf1b715ce77]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:15 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 Nov 05 03:54:15 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:15 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d6ef0a4f-907a-417f-bc25-8b2da53f23a8" returned: 0 in 0.501s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Lock "cinder-quobyte-d6ef0a4f-907a-417f-bc25-8b2da53f23a8" released by "delete_volume" :: held 1.251s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:15 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:54:15 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Created reservations ['a2e3d442-39a5-49e0-9f24-19cf22b8d808'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:15 devstack cinder-volume[87111]: WARNING cinder.quota [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1831562844 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1831562844, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:54:15 devstack cinder-volume[87111]: WARNING cinder.quota [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1831562844 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1831562844, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Created reservations ['753f3ff9-f498-441e-bdf3-c2df03808f4f', '1ce8497d-7ce3-4ee1-9c31-bcbb7a2e09b1', 'd192b2f3-e1a7-4d64-9735-caf9d7f3e77a', '65f1c22e-d04a-47c6-bda4-82d111654e65'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:15 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" returned: 0 in 0.748s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a85c7e-6b94-480b-a212-cd722614b50b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:15 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 1G Nov 05 03:54:15 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:15 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Created reservations ['de70eec0-d624-4c6f-887c-81b7a2d72bdd', 'ae92c630-6c1a-41d9-8aa7-e2e26b3bf4df', 'd121a0d4-b645-4e9b-bcb7-2c524584c642', '663bd55b-4318-4983-ae25-d112fef5a3bb'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:16 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.750s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:54:16 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:54:16 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:16 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.363s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:16 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-164d00a2-41d6-4990-a57f-ec7331f6f3bb tempest-GroupsTest-1477055178 None] Delete group completed successfully. Nov 05 03:54:16 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 1G" returned: 0 in 0.841s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:16 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 Nov 05 03:54:16 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:16 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158" returned: 0 in 0.523s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:16 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 is being set with open permissions: ugo+rw Nov 05 03:54:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:17 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 Nov 05 03:54:17 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:17 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158" returned: 0 in 0.307s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.645s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2b67edc4-1d01-435a-8df5-5defa8c72cb7 tempest-VolumesDeleteCascade-1033681115 None] Create snapshot completed successfully Nov 05 03:54:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-f2a85c7e-6b94-480b-a212-cd722614b50b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-f2a85c7e-6b94-480b-a212-cd722614b50b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Performing cascade delete. {{(pid=87111) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1000}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-2759b8f0-73c6-4d74-9481-2a1c9edcc3a0-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-2759b8f0-73c6-4d74-9481-2a1c9edcc3a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Deleting offline snapshot 2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 of volume f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] snapshot_file for this snap is: volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2717e1fb-4081-4851-aed5-e2abbec0fba3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:18 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 Nov 05 03:54:18 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:18 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" returned: 0 in 0.543s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a85c7e-6b94-480b-a212-cd722614b50b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f90644a-0944-4892-8c11-c556f55bbfa4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:19 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b Nov 05 03:54:19 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:19 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b" returned: 0 in 0.584s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:19 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b3bcf8-b4a7-4084-8c4b-4a98f9997e2b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:19 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 Nov 05 03:54:19 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:20 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158" returned: 0 in 0.661s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a85c7e-6b94-480b-a212-cd722614b50b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:20 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a43acd9-410e-4827-ab41-c8f9d30c07c6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:20 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 Nov 05 03:54:20 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:20 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" returned: 0 in 0.729s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a85c7e-6b94-480b-a212-cd722614b50b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:20 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b85ae-16ce-4d10-b61c-ab80a5f1e6ed]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:21 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b Nov 05 03:54:21 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:21 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b" returned: 0 in 0.687s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:21 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 Nov 05 03:54:21 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:22 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" returned: 0 in 0.480s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:22 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0 Nov 05 03:54:22 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:22 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" returned: 0 in 0.557s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 -F qcow2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:22 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 -F qcow2 Nov 05 03:54:22 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:23 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a85c7e-6b94-480b-a212-cd722614b50b /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 -F qcow2" returned: 0 in 0.745s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-2759b8f0-73c6-4d74-9481-2a1c9edcc3a0" released by "_delete_snapshot" :: held 5.286s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" released by "delete_snapshot" :: held 5.330s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Created reservations ['8af5f09b-3057-4677-8c90-1ea52b99f2b9', '881763eb-3489-4271-b7d9-31a8461f83e9', '929dc494-b8d6-4a4d-a620-33b5d7f62578', '5d8c9095-84cb-4a5d-835a-a9d6d60d1dad'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:23 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Delete snapshot completed successfully. Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-2759b8f0-73c6-4d74-9481-2a1c9edcc3a0-delete_snapshot" released by "delete_snapshot" :: held 5.655s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-7cdf97cf-df03-49e8-bacd-0c32476bc158-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-7cdf97cf-df03-49e8-bacd-0c32476bc158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-7cdf97cf-df03-49e8-bacd-0c32476bc158" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-7cdf97cf-df03-49e8-bacd-0c32476bc158" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Deleting offline snapshot 7cdf97cf-df03-49e8-bacd-0c32476bc158 of volume f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] snapshot_file for this snap is: volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47deb6d-97f3-4d4c-8224-a8ff6923477b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:24 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 Nov 05 03:54:24 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:24 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158" returned: 0 in 0.545s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a85c7e-6b94-480b-a212-cd722614b50b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:24 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6568eaf6-2525-45f5-89bf-de02d10ff42e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:24 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b Nov 05 03:54:24 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:25 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b" returned: 0 in 0.645s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:25 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 Nov 05 03:54:25 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:25 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158" returned: 0 in 0.673s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:25 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158 Nov 05 03:54:25 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:26 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b.7cdf97cf-df03-49e8-bacd-0c32476bc158" returned: 0 in 0.387s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-7cdf97cf-df03-49e8-bacd-0c32476bc158" released by "_delete_snapshot" :: held 2.417s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" released by "delete_snapshot" :: held 2.467s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Created reservations ['abbf6dcc-ddd9-4391-91bb-20821a8e905f', 'd85be88b-91ac-4e1d-8984-6ee8c348784a', '23c57b6e-8366-41d6-a847-326789262914', 'ce943f91-4ae5-4510-8351-d25c016749a1'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:26 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Delete snapshot completed successfully. Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-7cdf97cf-df03-49e8-bacd-0c32476bc158-delete_snapshot" released by "delete_snapshot" :: held 2.716s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Snapshots deleted, issuing volume delete {{(pid=87111) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}} Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94ffbe-681c-436d-8826-d2f6bb4b68ac]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:26 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b Nov 05 03:54:26 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:27 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b" returned: 0 in 0.623s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:27 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b Nov 05 03:54:27 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:27 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a85c7e-6b94-480b-a212-cd722614b50b" returned: 0 in 0.309s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-f2a85c7e-6b94-480b-a212-cd722614b50b" released by "delete_volume" :: held 1.046s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Created reservations ['a927ba0d-7dd2-41de-95ee-d84ab9a1a1e9', '4b101fe3-5196-4f10-9509-cac2163ce1e3', '9c7bb28a-ea2d-43dc-a261-34ddc973967a', '0a328237-7a1f-4098-b455-8861e4190380'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:27 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:54:27 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:28 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.315s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:28 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Deleted volume successfully. Nov 05 03:54:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff0ef8fb-d98d-4c42-bb7c-dfcc0511b279 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-f2a85c7e-6b94-480b-a212-cd722614b50b-delete_volume" released by "delete_volume" :: held 10.139s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Flow 'volume_create_manager' (939b3ee6-5778-44bf-abd7-e415da6ae955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f1d79a-5c32-4978-93d8-bd63dbf2f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f1d79a-5c32-4978-93d8-bd63dbf2f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1878559039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e119c432-86f6-48bc-a737-98858267c5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ad65fc420f4bf595c2b85b5cef23dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:29Z,use_quota=True,user_id='f051555f1be14a93bfe0a01cc6ced822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fbee14b-dc41-4bc7-80f5-7a46dac14b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fbee14b-dc41-4bc7-80f5-7a46dac14b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1186fb80-9919-4840-8247-ffd66377ee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1186fb80-9919-4840-8247-ffd66377ee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e119c432-86f6-48bc-a737-98858267c5c4', 'volume_name': 'volume-e119c432-86f6-48bc-a737-98858267c5c4', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e777ecc-c0a0-4faa-8172-3175f3815193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e777ecc-c0a0-4faa-8172-3175f3815193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5b76bc-cd45-4d21-ad92-6ad3c41b3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Volume e119c432-86f6-48bc-a737-98858267c5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e119c432-86f6-48bc-a737-98858267c5c4', 'volume_size': 1} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1878559039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e119c432-86f6-48bc-a737-98858267c5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ad65fc420f4bf595c2b85b5cef23dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:29Z,use_quota=True,user_id='f051555f1be14a93bfe0a01cc6ced822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Creating volume e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:29 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:29 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 1073741824 Nov 05 03:54:29 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:29 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 1073741824" returned: 0 in 0.439s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:29 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 Nov 05 03:54:29 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:30 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4" returned: 0 in 0.240s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5b76bc-cd45-4d21-ad92-6ad3c41b3648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e119c432-86f6-48bc-a737-98858267c5c4', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe295ae-182e-46f8-baa5-7364f5456c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:30 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Volume volume-e119c432-86f6-48bc-a737-98858267c5c4 (e119c432-86f6-48bc-a737-98858267c5c4): created successfully Nov 05 03:54:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe295ae-182e-46f8-baa5-7364f5456c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Flow 'volume_create_manager' (939b3ee6-5778-44bf-abd7-e415da6ae955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8d4fd329-aa66-4f44-8049-a11bfe1144c4 tempest-VolumesDeleteCascade-1033681115 None] Created volume successfully. Nov 05 03:54:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Creating offline snapshot 2100836c-29ab-4ab6-b04a-7457ce1a9819 of volume e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:54:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2137c8c7-c0af-45b4-899a-0385372f7fba]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:31 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 Nov 05 03:54:31 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:31 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4" returned: 0 in 0.385s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:31 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 1G Nov 05 03:54:31 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:32 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 1G" returned: 0 in 0.538s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e119c432-86f6-48bc-a737-98858267c5c4 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:32 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e119c432-86f6-48bc-a737-98858267c5c4 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 Nov 05 03:54:32 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:32 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e119c432-86f6-48bc-a737-98858267c5c4 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819" returned: 0 in 0.337s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:32 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 is being set with open permissions: ugo+rw Nov 05 03:54:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:32 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 Nov 05 03:54:32 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:33 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819" returned: 0 in 0.343s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:33 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.info Nov 05 03:54:33 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:33 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.info" returned: 0 in 0.309s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:33 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.info is being set with open permissions: ugo+rw Nov 05 03:54:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:33 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.info Nov 05 03:54:33 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:33 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.info" returned: 0 in 0.302s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:33 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-28e0a907-08cb-4dbd-86d5-422131e1da00 tempest-VolumesDeleteCascade-1033681115 None] Create snapshot completed successfully Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Flow 'volume_create_manager' (afd46b43-b98b-4107-90e4-65e563387760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0286235-37f7-4380-a3ab-c10273440546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0286235-37f7-4380-a3ab-c10273440546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-255798472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0f419f-afa8-41b8-80fd-220425f08184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ad65fc420f4bf595c2b85b5cef23dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2100836c-29ab-4ab6-b04a-7457ce1a9819,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:35Z,use_quota=True,user_id='f051555f1be14a93bfe0a01cc6ced822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefe66ed-878c-4b3b-9443-84aca8f83690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefe66ed-878c-4b3b-9443-84aca8f83690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731773a2-5772-4ee8-84f3-dd65641321de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731773a2-5772-4ee8-84f3-dd65641321de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e0f419f-afa8-41b8-80fd-220425f08184', 'volume_name': 'volume-0e0f419f-afa8-41b8-80fd-220425f08184', 'volume_size': 1, 'snapshot_id': '2100836c-29ab-4ab6-b04a-7457ce1a9819'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad1dfa-6d04-4b1c-91de-a18cc3e0fb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad1dfa-6d04-4b1c-91de-a18cc3e0fb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c085b895-1e22-4bf6-8c12-dd9ca60f3913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:35 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Volume 0e0f419f-afa8-41b8-80fd-220425f08184: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e0f419f-afa8-41b8-80fd-220425f08184', 'volume_size': 1, 'snapshot_id': '2100836c-29ab-4ab6-b04a-7457ce1a9819'} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-2100836c-29ab-4ab6-b04a-7457ce1a9819-0e0f419f-afa8-41b8-80fd-220425f08184" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-2100836c-29ab-4ab6-b04a-7457ce1a9819-0e0f419f-afa8-41b8-80fd-220425f08184" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Creating volume 0e0f419f-afa8-41b8-80fd-220425f08184 from snapshot 2100836c-29ab-4ab6-b04a-7457ce1a9819 {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-0e0f419f-afa8-41b8-80fd-220425f08184" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-0e0f419f-afa8-41b8-80fd-220425f08184" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] snapshot: 2100836c-29ab-4ab6-b04a-7457ce1a9819, volume: 0e0f419f-afa8-41b8-80fd-220425f08184, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7f9dc3-1129-4bce-ac8a-b7716e22cb09]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:35 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 Nov 05 03:54:35 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:35 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819" returned: 0 in 0.427s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e119c432-86f6-48bc-a737-98858267c5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec59aaa-3932-41e0-9d02-af4a63ec6c8d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:36 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 Nov 05 03:54:36 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:36 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4" returned: 0 in 0.383s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:54:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:54:36 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:54:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:36 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 Nov 05 03:54:36 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:44 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184" returned: 0 in 8.142s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4, size 1024.00 MB, duration 8.15 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:54:44 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Converted 1024.00 MB image at 125.71 MB/s Nov 05 03:54:44 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 is being set with open permissions: ugo+rw Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:44 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 Nov 05 03:54:44 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:44 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184" returned: 0 in 0.297s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-0e0f419f-afa8-41b8-80fd-220425f08184" released by "_copy_volume_from_snapshot" :: held 9.351s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=118,cinder:UPDATE=103,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=106,cinder:UPDATE=109,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-2100836c-29ab-4ab6-b04a-7457ce1a9819-0e0f419f-afa8-41b8-80fd-220425f08184" released by "_create_volume_from_snapshot" :: held 9.447s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.466s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c085b895-1e22-4bf6-8c12-dd9ca60f3913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0f419f-afa8-41b8-80fd-220425f08184', 'volume_size': 1, 'snapshot_id': '2100836c-29ab-4ab6-b04a-7457ce1a9819'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c16102-aba5-4efc-83d4-9b2f545e7fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:44 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Volume volume-0e0f419f-afa8-41b8-80fd-220425f08184 (0e0f419f-afa8-41b8-80fd-220425f08184): created successfully Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c16102-aba5-4efc-83d4-9b2f545e7fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Flow 'volume_create_manager' (afd46b43-b98b-4107-90e4-65e563387760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:44 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fd751d4f-e7e7-4f83-a51b-9aa2465e8d0e tempest-VolumesDeleteCascade-1033681115 None] Created volume successfully. Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-e119c432-86f6-48bc-a737-98858267c5c4-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-e119c432-86f6-48bc-a737-98858267c5c4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Performing cascade delete. {{(pid=87111) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1000}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-2100836c-29ab-4ab6-b04a-7457ce1a9819-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-2100836c-29ab-4ab6-b04a-7457ce1a9819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-e119c432-86f6-48bc-a737-98858267c5c4" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-e119c432-86f6-48bc-a737-98858267c5c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-2100836c-29ab-4ab6-b04a-7457ce1a9819" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-2100836c-29ab-4ab6-b04a-7457ce1a9819" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Deleting offline snapshot 2100836c-29ab-4ab6-b04a-7457ce1a9819 of volume e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] snapshot_file for this snap is: volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8690510-0070-4bfa-830e-db58a3c5e0fc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:45 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 Nov 05 03:54:45 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:46 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819" returned: 0 in 0.397s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e119c432-86f6-48bc-a737-98858267c5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:46 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8805cb-206a-4627-85e7-0fda2fa72199]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:46 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 Nov 05 03:54:46 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:46 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4" returned: 0 in 0.584s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:46 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 Nov 05 03:54:46 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:47 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819" returned: 0 in 0.397s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:47 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819 Nov 05 03:54:47 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:47 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4.2100836c-29ab-4ab6-b04a-7457ce1a9819" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-2100836c-29ab-4ab6-b04a-7457ce1a9819" released by "_delete_snapshot" :: held 1.775s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-e119c432-86f6-48bc-a737-98858267c5c4" released by "delete_snapshot" :: held 1.803s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Created reservations ['a9433a6b-ed3b-4250-956d-ba86e8c150c8', '106642c8-e93f-439e-b9ba-b4877b93e9f9', '99d761ef-b2a9-4c81-99ce-835b71fd79bd', 'c52d2ffb-26d2-41bb-9b9d-1a7ce6e1a907'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:47 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Delete snapshot completed successfully. Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-2100836c-29ab-4ab6-b04a-7457ce1a9819-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Snapshots deleted, issuing volume delete {{(pid=87111) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-e119c432-86f6-48bc-a737-98858267c5c4" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-e119c432-86f6-48bc-a737-98858267c5c4" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf2daa8-aa33-4eba-b563-a0f70066a8e5]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:47 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 Nov 05 03:54:47 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:48 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4" returned: 0 in 0.543s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:48 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4 Nov 05 03:54:48 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:48 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e119c432-86f6-48bc-a737-98858267c5c4" returned: 0 in 0.387s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-e119c432-86f6-48bc-a737-98858267c5c4" released by "delete_volume" :: held 1.047s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Created reservations ['9c958cd6-2b76-4e2f-8be8-de62d23f0a8d', 'ac47dfd7-477b-47f3-9225-a7917c64fcbc', 'c59ec0ef-d3c9-4b70-bd87-174b29347ea1', 'b8463807-ce45-45c8-9b37-98274020e789'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:48 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:54:48 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-b503590b-b70a-47b1-9a46-c6d189607fb2 req-ed494b6e-ecab-4dd0-95a2-6b98d3823f9f tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-b503590b-b70a-47b1-9a46-c6d189607fb2 req-ed494b6e-ecab-4dd0-95a2-6b98d3823f9f tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-b503590b-b70a-47b1-9a46-c6d189607fb2 req-ed494b6e-ecab-4dd0-95a2-6b98d3823f9f tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-b503590b-b70a-47b1-9a46-c6d189607fb2 req-ed494b6e-ecab-4dd0-95a2-6b98d3823f9f tempest-TestInstancesWithCinderVolumes-328084730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-271f6f97-ca10-4601-8c90-7d8220500b49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fefebab6-faf2-4e0e-a6d4-8ee62cf096a9', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:54:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-b503590b-b70a-47b1-9a46-c6d189607fb2 req-ed494b6e-ecab-4dd0-95a2-6b98d3823f9f tempest-TestInstancesWithCinderVolumes-328084730 None] attachment_update completed successfully. Nov 05 03:54:49 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.362s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:49 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Deleted volume successfully. Nov 05 03:54:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-97effb6f-4c64-44f6-ab74-19459c44b3a3 tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-e119c432-86f6-48bc-a737-98858267c5c4-delete_volume" released by "delete_volume" :: held 3.807s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-0e0f419f-afa8-41b8-80fd-220425f08184-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-0e0f419f-afa8-41b8-80fd-220425f08184-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "cinder-quobyte-0e0f419f-afa8-41b8-80fd-220425f08184" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-0e0f419f-afa8-41b8-80fd-220425f08184" acquired by "delete_volume" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:50 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c0277c-dff9-4b21-8945-d47a051e520d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:50 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 Nov 05 03:54:50 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:50 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:50 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184 Nov 05 03:54:50 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:51 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0e0f419f-afa8-41b8-80fd-220425f08184" returned: 0 in 0.325s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-quobyte-0e0f419f-afa8-41b8-80fd-220425f08184" released by "delete_volume" :: held 0.794s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Created reservations ['3afd5bf0-326b-4db0-96b5-f10553c53dfb', '9aa1d982-3b41-413a-9368-5ff13bd4b779', '171a95d5-b754-405a-93d8-c06e2e5857f2', 'c8a84c30-c931-4041-a364-3075d00bd91b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:51 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:54:51 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:51 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.490s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Deleted volume successfully. Nov 05 03:54:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c4fd9bb0-47f4-46f4-861d-1318a3bf535a tempest-VolumesDeleteCascade-1033681115 None] Lock "cinder-0e0f419f-afa8-41b8-80fd-220425f08184-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-59dfa407-8891-4a65-892e-d9622795f632 req-40158cec-4fcb-4276-a0c9-379d615651c0 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-59dfa407-8891-4a65-892e-d9622795f632 req-40158cec-4fcb-4276-a0c9-379d615651c0 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-59dfa407-8891-4a65-892e-d9622795f632 req-40158cec-4fcb-4276-a0c9-379d615651c0 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-59dfa407-8891-4a65-892e-d9622795f632 req-40158cec-4fcb-4276-a0c9-379d615651c0 tempest-TestInstancesWithCinderVolumes-328084730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-7e212830-0632-4cc9-a490-2e75890d6021', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07a8f367-e7dd-49da-b6f5-0e991b45a93c', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:54:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-59dfa407-8891-4a65-892e-d9622795f632 req-40158cec-4fcb-4276-a0c9-379d615651c0 tempest-TestInstancesWithCinderVolumes-328084730 None] attachment_update completed successfully. Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Flow 'volume_create_manager' (93a3bf38-e02e-4545-8b63-30bd20d29416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d826d3-37a2-4811-8355-692ad8eeac5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d826d3-37a2-4811-8355-692ad8eeac5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1755047609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f3370a-c213-4989-b7ea-1ced1c3ee43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c804ad569074dd08365001c8aad0c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:57Z,use_quota=True,user_id='353eb86fd6c547e7b83c6bec16562fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65050de-b696-432f-9f7c-66738b2cc36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65050de-b696-432f-9f7c-66738b2cc36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d6bbd1-0650-47da-83db-7098ad154cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d6bbd1-0650-47da-83db-7098ad154cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f3370a-c213-4989-b7ea-1ced1c3ee43f', 'volume_name': 'volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef41230-ae40-491d-ae49-cf4cec31f261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef41230-ae40-491d-ae49-cf4cec31f261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f222155b-4d0f-4300-9207-865f0c6364d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:57 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Volume f1f3370a-c213-4989-b7ea-1ced1c3ee43f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f', 'volume_size': 1} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1755047609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f3370a-c213-4989-b7ea-1ced1c3ee43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c804ad569074dd08365001c8aad0c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:57Z,use_quota=True,user_id='353eb86fd6c547e7b83c6bec16562fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Creating volume f1f3370a-c213-4989-b7ea-1ced1c3ee43f {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:57 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:57 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f 1073741824 Nov 05 03:54:57 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:57 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f 1073741824" returned: 0 in 0.551s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:57 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f Nov 05 03:54:57 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:58 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f" returned: 0 in 0.263s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f222155b-4d0f-4300-9207-865f0c6364d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18752da2-f737-4a27-9ce5-94688f57afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:58 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Volume volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f (f1f3370a-c213-4989-b7ea-1ced1c3ee43f): created successfully Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18752da2-f737-4a27-9ce5-94688f57afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Flow 'volume_create_manager' (93a3bf38-e02e-4545-8b63-30bd20d29416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-320fe391-6681-4d7c-98ec-88fc84d8bcd4 tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Created volume successfully. Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Flow 'volume_create_manager' (685bbaad-a8da-4d52-bc1f-6b3b677ecc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9b8fa7-0167-481d-b9d9-c64a6f0cb06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9b8fa7-0167-481d-b9d9-c64a6f0cb06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2120199690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339c1e6bd95e43d9943d8c52be21a8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:58Z,use_quota=True,user_id='93be06ac9fae43c880bce8bb62e4f698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a9b7b6-6172-4b46-933a-2037fd3ad3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a9b7b6-6172-4b46-933a-2037fd3ad3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe23c43f-f87b-4a83-aa6c-6f8be064fa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe23c43f-f87b-4a83-aa6c-6f8be064fa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750', 'volume_name': 'volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a708f9e4-498a-4c41-a0ba-4e9f67559ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a708f9e4-498a-4c41-a0ba-4e9f67559ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e7afd4-b682-4bc5-b905-a905de42a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:58 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Volume ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750', 'volume_size': 1} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2120199690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339c1e6bd95e43d9943d8c52be21a8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:58Z,use_quota=True,user_id='93be06ac9fae43c880bce8bb62e4f698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Creating volume ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:58 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:58 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 1073741824 Nov 05 03:54:58 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:58 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 1073741824" returned: 0 in 0.509s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:59 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 Nov 05 03:54:59 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-b60dcbc0-a9a8-4599-bc62-18c8afa17a92 req-142c35c0-4daa-460c-ad6f-17531a743cb0 tempest-TestInstancesWithCinderVolumes-328084730 None] Terminate volume connection completed successfully. Nov 05 03:54:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-b60dcbc0-a9a8-4599-bc62-18c8afa17a92 req-142c35c0-4daa-460c-ad6f-17531a743cb0 tempest-TestInstancesWithCinderVolumes-328084730 None] Deleting attachment fefebab6-faf2-4e0e-a6d4-8ee62cf096a9. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:54:59 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750" returned: 0 in 0.292s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e7afd4-b682-4bc5-b905-a905de42a39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3c6e6c-dc6f-4749-b988-c99e063da981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Volume volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 (ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750): created successfully Nov 05 03:54:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3c6e6c-dc6f-4749-b988-c99e063da981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Flow 'volume_create_manager' (685bbaad-a8da-4d52-bc1f-6b3b677ecc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-48d92619-508e-401d-b7fe-4512f2a427b5 tempest-VolumesTransfersTest-2001901352 None] Created volume successfully. Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "cinder-271f6f97-ca10-4601-8c90-7d8220500b49-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-271f6f97-ca10-4601-8c90-7d8220500b49-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "cinder-quobyte-271f6f97-ca10-4601-8c90-7d8220500b49" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:00 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-bf669eb8-b771-43d2-95c2-a98364b2f7ff tempest-VolumesTransfersTest-1888551665 None] Transfer volume completed successfully. Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-quobyte-271f6f97-ca10-4601-8c90-7d8220500b49" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbd15ef-d320-4e37-ba93-5adc1572e3fb]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:00 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 Nov 05 03:55:00 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Acquiring lock "cinder-f1f3370a-c213-4989-b7ea-1ced1c3ee43f-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "cinder-f1f3370a-c213-4989-b7ea-1ced1c3ee43f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Acquiring lock "cinder-quobyte-f1f3370a-c213-4989-b7ea-1ced1c3ee43f" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "cinder-quobyte-f1f3370a-c213-4989-b7ea-1ced1c3ee43f" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5506bc38-d529-4d5f-83ae-cbbaca41f2d9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:00 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49" returned: 0 in 0.553s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:00 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49 Nov 05 03:55:00 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:00 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f Nov 05 03:55:00 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Acquiring lock "cinder-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Lock "cinder-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Acquiring lock "cinder-quobyte-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Lock "cinder-quobyte-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:01 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271f6f97-ca10-4601-8c90-7d8220500b49" returned: 0 in 0.380s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0650adff-897e-410c-a683-b2d07eae3f18]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-quobyte-271f6f97-ca10-4601-8c90-7d8220500b49" released by "delete_volume" :: held 1.013s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:01 devstack cinder-volume[87111]: WARNING cinder.quota [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1961155926-2030963349 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1961155926-2030963349, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:55:01 devstack cinder-volume[87111]: WARNING cinder.quota [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1961155926-2030963349 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1961155926-2030963349, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Created reservations ['f61698ba-b63d-4f42-898a-92e440621228', '21f4e7dd-abd0-4271-b25e-41fa22bafaaa', '007ca6d9-2329-4ab6-9c36-ceedd43c8d3e', 'eab5767b-2cb3-4a49-a18e-b9067fc5b5d4'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:01 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f" returned: 0 in 0.555s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:01 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 Nov 05 03:55:01 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:01 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f Nov 05 03:55:01 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:01 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:01 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:01 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750" returned: 0 in 0.472s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:01 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f1f3370a-c213-4989-b7ea-1ced1c3ee43f" returned: 0 in 0.348s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:01 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750 Nov 05 03:55:01 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "cinder-quobyte-f1f3370a-c213-4989-b7ea-1ced1c3ee43f" released by "delete_volume" :: held 0.972s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:01 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.382s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Deleted volume successfully. Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Created reservations ['a330b229-c2a7-4366-ae2b-4155eda49ab4', '6d1e9134-1e95-4a9f-863d-b9260f2a5d63', 'acd33621-63b3-4eb9-a278-833d7c81558d', 'd1d70573-c020-43d7-9b70-75898c6a9c59'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6dca36fa-8a07-463b-9c39-4157f1d4c682 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-271f6f97-ca10-4601-8c90-7d8220500b49-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:02 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:02 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:02 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750" returned: 0 in 0.334s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Lock "cinder-quobyte-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750" released by "delete_volume" :: held 0.863s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Created reservations ['7077b4e1-aec2-482b-a21b-7e0ad9268431', '6c26d9b6-cc0a-474b-89b4-539e6e00fb83', '9a4a874c-9029-4c2e-93b6-7ab25d6ada7b', '5f10bd99-d743-4f52-a5e4-509a3a4b6323'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:02 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:02 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:02 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.348s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Deleted volume successfully. Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f488b3a7-4a09-4658-8547-166ac78ef4db tempest-VolumeQuotasNegativeTestJSON-1641133475 None] Lock "cinder-f1f3370a-c213-4989-b7ea-1ced1c3ee43f-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:02 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.337s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Deleted volume successfully. Nov 05 03:55:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85c57fba-8e6e-4280-9dd6-16501f81ad0b tempest-VolumesTransfersTest-1334805091 None] Lock "cinder-ca214d4a-4e96-43aa-b9d2-ca8cb2ac2750-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Flow 'volume_create_manager' (7ef47856-d695-4472-bc24-c91e0d242c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236e58fd-8677-437a-9721-41c0ca7f66a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236e58fd-8677-437a-9721-41c0ca7f66a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2036782167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea795752-e65b-4078-8206-35998f49f569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339c1e6bd95e43d9943d8c52be21a8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:03Z,use_quota=True,user_id='93be06ac9fae43c880bce8bb62e4f698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e38e42a-30f5-478b-b898-355d7988d7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e38e42a-30f5-478b-b898-355d7988d7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d0be04-e1ad-4534-81a9-fc47817f1011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d0be04-e1ad-4534-81a9-fc47817f1011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea795752-e65b-4078-8206-35998f49f569', 'volume_name': 'volume-ea795752-e65b-4078-8206-35998f49f569', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4aafea-ac08-4b96-9d13-0a324a97abe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4aafea-ac08-4b96-9d13-0a324a97abe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc32daba-7679-45ef-bb8a-5b92df968b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Volume ea795752-e65b-4078-8206-35998f49f569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea795752-e65b-4078-8206-35998f49f569', 'volume_size': 1} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2036782167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea795752-e65b-4078-8206-35998f49f569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339c1e6bd95e43d9943d8c52be21a8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:03Z,use_quota=True,user_id='93be06ac9fae43c880bce8bb62e4f698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Creating volume ea795752-e65b-4078-8206-35998f49f569 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:03 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:03 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 1073741824 Nov 05 03:55:03 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:03 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 1073741824" returned: 0 in 0.553s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:03 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 Nov 05 03:55:03 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:04 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569" returned: 0 in 0.325s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc32daba-7679-45ef-bb8a-5b92df968b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea795752-e65b-4078-8206-35998f49f569', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1ad910-400c-49ae-8969-36af18af1267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Volume volume-ea795752-e65b-4078-8206-35998f49f569 (ea795752-e65b-4078-8206-35998f49f569): created successfully Nov 05 03:55:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1ad910-400c-49ae-8969-36af18af1267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Flow 'volume_create_manager' (7ef47856-d695-4472-bc24-c91e0d242c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-416d7f0c-36b4-4bed-8dd5-a0d48079b804 tempest-VolumesTransfersTest-2001901352 None] Created volume successfully. Nov 05 03:55:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-4830314a-7398-496f-ac09-84fa8e71d258 req-b6d6130b-1137-4c4c-871a-21aa86934da5 tempest-TestInstancesWithCinderVolumes-328084730 None] Terminate volume connection completed successfully. Nov 05 03:55:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-4830314a-7398-496f-ac09-84fa8e71d258 req-b6d6130b-1137-4c4c-871a-21aa86934da5 tempest-TestInstancesWithCinderVolumes-328084730 None] Deleting attachment 07a8f367-e7dd-49da-b6f5-0e991b45a93c. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Acquiring lock "cinder-ea795752-e65b-4078-8206-35998f49f569-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Lock "cinder-ea795752-e65b-4078-8206-35998f49f569-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Acquiring lock "cinder-quobyte-ea795752-e65b-4078-8206-35998f49f569" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Lock "cinder-quobyte-ea795752-e65b-4078-8206-35998f49f569" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[93430312-59df-48cd-b791-d83df935312e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "cinder-7e212830-0632-4cc9-a490-2e75890d6021-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-7e212830-0632-4cc9-a490-2e75890d6021-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "cinder-quobyte-7e212830-0632-4cc9-a490-2e75890d6021" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-quobyte-7e212830-0632-4cc9-a490-2e75890d6021" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:05 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 Nov 05 03:55:05 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad660c-0c15-4f96-bca2-09d909436013]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:05 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 Nov 05 03:55:05 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:06 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569" returned: 0 in 0.588s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:06 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569 Nov 05 03:55:06 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:06 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021" returned: 0 in 0.512s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:06 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021 Nov 05 03:55:06 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:06 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ea795752-e65b-4078-8206-35998f49f569" returned: 0 in 0.359s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Lock "cinder-quobyte-ea795752-e65b-4078-8206-35998f49f569" released by "delete_volume" :: held 1.025s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Created reservations ['38396481-85eb-421b-a1a1-871e8433b920', '163cd6cd-aba2-4882-8bcc-d47f408b55bd', 'edddb921-0660-4b22-b9d7-8db88a6d582e', 'f4b89fdc-1445-4e50-945b-ae09a0b5e7fe'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:06 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7e212830-0632-4cc9-a490-2e75890d6021" returned: 0 in 0.398s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-quobyte-7e212830-0632-4cc9-a490-2e75890d6021" released by "delete_volume" :: held 1.002s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:06 devstack cinder-volume[87111]: WARNING cinder.quota [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295493136-1864474629 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295493136-1864474629, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:55:06 devstack cinder-volume[87111]: WARNING cinder.quota [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295493136-1864474629 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295493136-1864474629, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:06 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Created reservations ['5467f97d-527a-42f4-8f3d-93ba77a750a0', '144b3419-7241-4c0d-b8d5-5ba7c96c0b08', 'c4cb3b89-7614-4c6a-aa73-8aaadb1ba2a9', '8cfd61fb-0cd4-473f-9a7c-90d33ba20054'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:06 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:06 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:06 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:07 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.377s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:07 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:07 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Deleted volume successfully. Nov 05 03:55:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-178ac1c6-4c59-456f-aa8c-1629d9c0f9a7 tempest-VolumesTransfersTest-1334805091 None] Lock "cinder-ea795752-e65b-4078-8206-35998f49f569-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:07 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.379s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:07 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:07 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Deleted volume successfully. Nov 05 03:55:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8c4ef33d-88c3-4ac8-92e7-8a0f835e58f3 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-7e212830-0632-4cc9-a490-2e75890d6021-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-b581d765-46ef-4dce-afad-f616e13287a6 req-2c8ca1a1-3ac8-4bcf-9976-941390710be9 tempest-TestInstancesWithCinderVolumes-328084730 None] Terminate volume connection completed successfully. Nov 05 03:55:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-b581d765-46ef-4dce-afad-f616e13287a6 req-2c8ca1a1-3ac8-4bcf-9976-941390710be9 tempest-TestInstancesWithCinderVolumes-328084730 None] Deleting attachment e5648356-25d5-462a-a38d-60d7fac3df80. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:55:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "cinder-318d927a-deda-4221-9db4-3767f5e76fa5-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-318d927a-deda-4221-9db4-3767f5e76fa5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "cinder-quobyte-318d927a-deda-4221-9db4-3767f5e76fa5" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-quobyte-318d927a-deda-4221-9db4-3767f5e76fa5" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cfaf9d-3acb-4e76-92d2-0f985f50df85]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:12 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 Nov 05 03:55:12 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:13 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5" returned: 0 in 0.449s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:13 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5 Nov 05 03:55:13 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:13 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-318d927a-deda-4221-9db4-3767f5e76fa5" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-quobyte-318d927a-deda-4221-9db4-3767f5e76fa5" released by "delete_volume" :: held 0.846s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:13 devstack cinder-volume[87111]: WARNING cinder.quota [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1104786469-257676374 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1104786469-257676374, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:55:13 devstack cinder-volume[87111]: WARNING cinder.quota [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1104786469-257676374 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1104786469-257676374, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Created reservations ['c1b0d7fd-8d1e-4fd3-9238-399b0ff899e5', '0f01e3af-6055-4714-b8bb-daf85e714684', '3b0b377f-09d5-4f10-8095-2bcd9a51686e', '42d0662b-4ed0-46d7-9d6a-90e75b02e7f7'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:13 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:13 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:13 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.339s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:13 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Deleted volume successfully. Nov 05 03:55:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-dd03ec08-2e86-436a-8f4a-1d3e6351dca6 tempest-TestInstancesWithCinderVolumes-328084730 None] Lock "cinder-318d927a-deda-4221-9db4-3767f5e76fa5-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:15 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:15 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:15 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.367s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:55:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Flow 'volume_create_manager' (e2531902-ce2d-41fc-95f5-b0091da30eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b0a1e2-e015-430c-ac04-de4b98ab14d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b0a1e2-e015-430c-ac04-de4b98ab14d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2058890583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4adaf05-829b-4796-8681-ee4f1b705230,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9c2a25883164c34a872e40b562f1156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:18Z,use_quota=True,user_id='e756610fbdb1469caecdc9e9363f12e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f87595-f6f5-4ecc-a5dc-d75e7fba073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f87595-f6f5-4ecc-a5dc-d75e7fba073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c258f6-428f-455f-a2fc-9bba0bae6003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c258f6-428f-455f-a2fc-9bba0bae6003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4adaf05-829b-4796-8681-ee4f1b705230', 'volume_name': 'volume-e4adaf05-829b-4796-8681-ee4f1b705230', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1de27e-fde3-45af-8757-9b4610dfe0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1de27e-fde3-45af-8757-9b4610dfe0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6d4b30-2cf6-4fa5-961e-9423575b7feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:17 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Volume e4adaf05-829b-4796-8681-ee4f1b705230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4adaf05-829b-4796-8681-ee4f1b705230', 'volume_size': 1} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2058890583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4adaf05-829b-4796-8681-ee4f1b705230,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9c2a25883164c34a872e40b562f1156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:18Z,use_quota=True,user_id='e756610fbdb1469caecdc9e9363f12e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Creating volume e4adaf05-829b-4796-8681-ee4f1b705230 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:17 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:55:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:18 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 1073741824 Nov 05 03:55:18 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:18 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 1073741824" returned: 0 in 0.528s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:18 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 Nov 05 03:55:18 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:18 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230" returned: 0 in 0.276s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6d4b30-2cf6-4fa5-961e-9423575b7feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4adaf05-829b-4796-8681-ee4f1b705230', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c3a57b-ecb8-48b6-9b2c-7402a845cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:18 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Volume volume-e4adaf05-829b-4796-8681-ee4f1b705230 (e4adaf05-829b-4796-8681-ee4f1b705230): created successfully Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c3a57b-ecb8-48b6-9b2c-7402a845cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Flow 'volume_create_manager' (e2531902-ce2d-41fc-95f5-b0091da30eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-580a25de-44c3-419a-a608-97aad7f75a88 tempest-VolumesListTestJSON-2065991928 None] Created volume successfully. Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Flow 'volume_create_manager' (fc2a2770-e4fa-4336-a0d4-4d75e6fa8cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadbf7d9-5bc7-4374-8049-c6d3d4bf9015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadbf7d9-5bc7-4374-8049-c6d3d4bf9015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-983911089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4945dafe-58f7-42c3-9aab-0d653010ed56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d813f2014c4819a280907d471c488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:19Z,use_quota=True,user_id='bc84f39a4f28455d93994cd5e3827efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beb3b51-525f-4484-955a-79b0cfa29afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beb3b51-525f-4484-955a-79b0cfa29afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d734897-7b96-428a-b167-beb87610c3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d734897-7b96-428a-b167-beb87610c3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4945dafe-58f7-42c3-9aab-0d653010ed56', 'volume_name': 'volume-4945dafe-58f7-42c3-9aab-0d653010ed56', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e5d0b3-77e8-4290-8cb5-0896cb0ef143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e5d0b3-77e8-4290-8cb5-0896cb0ef143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b5fa0-311e-43d2-837d-053a882f7ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:19 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Volume 4945dafe-58f7-42c3-9aab-0d653010ed56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4945dafe-58f7-42c3-9aab-0d653010ed56', 'volume_size': 1} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-983911089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4945dafe-58f7-42c3-9aab-0d653010ed56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d813f2014c4819a280907d471c488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:19Z,use_quota=True,user_id='bc84f39a4f28455d93994cd5e3827efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Creating volume 4945dafe-58f7-42c3-9aab-0d653010ed56 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:19 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:55:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:19 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 1073741824 Nov 05 03:55:19 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:20 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 1073741824" returned: 0 in 0.601s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:20 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 Nov 05 03:55:20 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:20 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56" returned: 0 in 0.305s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b5fa0-311e-43d2-837d-053a882f7ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4945dafe-58f7-42c3-9aab-0d653010ed56', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c4e61c-0aed-4665-8a4f-f77b2bb0cf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Flow 'volume_create_manager' (3e0d9307-241d-4d57-a139-254ad034dace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768c4e66-2059-4020-ac27-802ea4f946b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Volume volume-4945dafe-58f7-42c3-9aab-0d653010ed56 (4945dafe-58f7-42c3-9aab-0d653010ed56): created successfully Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c4e61c-0aed-4665-8a4f-f77b2bb0cf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Flow 'volume_create_manager' (fc2a2770-e4fa-4336-a0d4-4d75e6fa8cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768c4e66-2059-4020-ac27-802ea4f946b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2002878218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865b73dd-9c14-409a-801b-036751d8a117,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9c2a25883164c34a872e40b562f1156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:21Z,use_quota=True,user_id='e756610fbdb1469caecdc9e9363f12e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2544faba-2232-4521-9d63-2ffa3626db04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2544faba-2232-4521-9d63-2ffa3626db04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2f60e8-2f8a-4393-9a8c-64493da172e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2f60e8-2f8a-4393-9a8c-64493da172e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865b73dd-9c14-409a-801b-036751d8a117', 'volume_name': 'volume-865b73dd-9c14-409a-801b-036751d8a117', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9510aaa0-3b03-4dac-b9ac-0547d46b56f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9510aaa0-3b03-4dac-b9ac-0547d46b56f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e97dd34-a698-4436-a4b2-4fce27e6eb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Volume 865b73dd-9c14-409a-801b-036751d8a117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865b73dd-9c14-409a-801b-036751d8a117', 'volume_size': 1} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2002878218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865b73dd-9c14-409a-801b-036751d8a117,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9c2a25883164c34a872e40b562f1156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:21Z,use_quota=True,user_id='e756610fbdb1469caecdc9e9363f12e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Creating volume 865b73dd-9c14-409a-801b-036751d8a117 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:20 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:55:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:20 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 1073741824 Nov 05 03:55:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2848c8cf-a373-4b35-a595-60c17a0b7783 tempest-AbsoluteLimitsTests-557190799 None] Created volume successfully. Nov 05 03:55:20 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:21 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 1073741824" returned: 0 in 0.466s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:21 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 Nov 05 03:55:21 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:21 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117" returned: 0 in 0.287s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e97dd34-a698-4436-a4b2-4fce27e6eb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865b73dd-9c14-409a-801b-036751d8a117', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e3006-2149-4ac5-9666-151e96c081d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:21 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Volume volume-865b73dd-9c14-409a-801b-036751d8a117 (865b73dd-9c14-409a-801b-036751d8a117): created successfully Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e3006-2149-4ac5-9666-151e96c081d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Flow 'volume_create_manager' (3e0d9307-241d-4d57-a139-254ad034dace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:21 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c9efce08-b35c-4ef3-96d4-f478f0c7fd4a tempest-VolumesListTestJSON-2065991928 None] Created volume successfully. Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Acquiring lock "cinder-4945dafe-58f7-42c3-9aab-0d653010ed56-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Lock "cinder-4945dafe-58f7-42c3-9aab-0d653010ed56-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Acquiring lock "cinder-quobyte-4945dafe-58f7-42c3-9aab-0d653010ed56" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Lock "cinder-quobyte-4945dafe-58f7-42c3-9aab-0d653010ed56" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[247317c8-958d-43c4-ab66-d4a1c0a1b10e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:22 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 Nov 05 03:55:22 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:22 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56" returned: 0 in 0.399s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:22 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56 Nov 05 03:55:22 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:22 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4945dafe-58f7-42c3-9aab-0d653010ed56" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Lock "cinder-quobyte-4945dafe-58f7-42c3-9aab-0d653010ed56" released by "delete_volume" :: held 0.783s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Created reservations ['229eecd9-9472-4606-ae01-c5c94b8cb4e2', '92710913-fd9d-412a-9654-777270003dfd', 'fd8e6d66-baf7-49ff-86ae-df8bfd29b38f', 'aa9ac321-6376-47b9-a165-5c8b6d06db86'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:22 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:22 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:23 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.388s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:23 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Deleted volume successfully. Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f86b57a6-06d5-4c88-b13a-5655ee17173b tempest-AbsoluteLimitsTests-557190799 None] Lock "cinder-4945dafe-58f7-42c3-9aab-0d653010ed56-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Flow 'volume_create_manager' (11611f3d-6d26-44fe-91b7-3b9714b23bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea0a390-d1e6-42b7-ad56-91a3d8487b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea0a390-d1e6-42b7-ad56-91a3d8487b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1163800184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6347bd4e-e804-4a4e-be82-cd8a8433de70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9c2a25883164c34a872e40b562f1156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:23Z,use_quota=True,user_id='e756610fbdb1469caecdc9e9363f12e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b395311-de49-4046-95d1-18bd7628d1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b395311-de49-4046-95d1-18bd7628d1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2182f90f-adc5-4733-b59b-cda101d2b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2182f90f-adc5-4733-b59b-cda101d2b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6347bd4e-e804-4a4e-be82-cd8a8433de70', 'volume_name': 'volume-6347bd4e-e804-4a4e-be82-cd8a8433de70', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c0e88f-53b8-412b-9b8a-5ca48cebd15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c0e88f-53b8-412b-9b8a-5ca48cebd15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0b039a-b133-4f2e-b318-dd956e2a131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:23 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Volume 6347bd4e-e804-4a4e-be82-cd8a8433de70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6347bd4e-e804-4a4e-be82-cd8a8433de70', 'volume_size': 1} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1163800184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6347bd4e-e804-4a4e-be82-cd8a8433de70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9c2a25883164c34a872e40b562f1156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:23Z,use_quota=True,user_id='e756610fbdb1469caecdc9e9363f12e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Creating volume 6347bd4e-e804-4a4e-be82-cd8a8433de70 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:23 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:55:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:23 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 1073741824 Nov 05 03:55:23 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:24 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 1073741824" returned: 0 in 0.500s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:24 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 Nov 05 03:55:24 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:24 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70" returned: 0 in 0.445s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0b039a-b133-4f2e-b318-dd956e2a131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6347bd4e-e804-4a4e-be82-cd8a8433de70', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88677b18-42eb-4e7b-8b06-fcc10c033fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Volume volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 (6347bd4e-e804-4a4e-be82-cd8a8433de70): created successfully Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88677b18-42eb-4e7b-8b06-fcc10c033fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Flow 'volume_create_manager' (11611f3d-6d26-44fe-91b7-3b9714b23bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8a95648c-8fac-4e90-b2e0-ae698c25312a tempest-VolumesListTestJSON-2065991928 None] Created volume successfully. Nov 05 03:55:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "cinder-6347bd4e-e804-4a4e-be82-cd8a8433de70-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-6347bd4e-e804-4a4e-be82-cd8a8433de70-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "cinder-quobyte-6347bd4e-e804-4a4e-be82-cd8a8433de70" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-quobyte-6347bd4e-e804-4a4e-be82-cd8a8433de70" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:28 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd355030-50b7-4977-9383-e9ee87267563]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:28 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 Nov 05 03:55:28 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:29 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70" returned: 0 in 0.420s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:29 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70 Nov 05 03:55:29 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:29 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6347bd4e-e804-4a4e-be82-cd8a8433de70" returned: 0 in 0.281s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-quobyte-6347bd4e-e804-4a4e-be82-cd8a8433de70" released by "delete_volume" :: held 0.768s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Created reservations ['74fc8688-ed02-4878-8d6a-38a1445d15aa', '190b8aa1-9a19-4087-9b30-c4e8b0e87ba0', 'f0641929-b05c-4c3c-826b-6be182270904', '34d4f9c6-6ed7-4bb8-975d-be3bbf2044b6'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:29 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:29 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "cinder-865b73dd-9c14-409a-801b-036751d8a117-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-865b73dd-9c14-409a-801b-036751d8a117-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:29 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.324s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Deleted volume successfully. Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "cinder-quobyte-865b73dd-9c14-409a-801b-036751d8a117" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eeabf8d0-9422-45d1-845c-853eb5b2d797 tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-6347bd4e-e804-4a4e-be82-cd8a8433de70-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-quobyte-865b73dd-9c14-409a-801b-036751d8a117" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1a93eb-f927-42f7-93e3-b91c161e7e35]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:30 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 Nov 05 03:55:30 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:30 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117" returned: 0 in 0.446s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:30 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117 Nov 05 03:55:30 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Flow 'volume_create_manager' (bced5a22-6046-464b-b1d3-22429cdef485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c577db9-51ca-45cf-8894-d32ad046386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:30 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-865b73dd-9c14-409a-801b-036751d8a117" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c577db9-51ca-45cf-8894-d32ad046386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-907955602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7c6402-7f75-40e2-b472-27aba4a74c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d0ca2657ba4248b7bff58a644f5436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:31Z,use_quota=True,user_id='76427e8c79ba4c4687067f4ae2cdfd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a107392f-b073-4ac7-ae76-ff4fe8ccccca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a107392f-b073-4ac7-ae76-ff4fe8ccccca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d542e99-3605-41c0-9b87-b9792ca6d5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d542e99-3605-41c0-9b87-b9792ca6d5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7c6402-7f75-40e2-b472-27aba4a74c84', 'volume_name': 'volume-7c7c6402-7f75-40e2-b472-27aba4a74c84', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee4d364-991c-4b5e-8940-31de0091f21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee4d364-991c-4b5e-8940-31de0091f21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3846a30b-2084-47c0-aab3-e3e8943e9f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:30 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Volume 7c7c6402-7f75-40e2-b472-27aba4a74c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7c6402-7f75-40e2-b472-27aba4a74c84', 'volume_size': 1} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-907955602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7c6402-7f75-40e2-b472-27aba4a74c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d0ca2657ba4248b7bff58a644f5436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:31Z,use_quota=True,user_id='76427e8c79ba4c4687067f4ae2cdfd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Creating volume 7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:30 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-quobyte-865b73dd-9c14-409a-801b-036751d8a117" released by "delete_volume" :: held 0.876s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:30 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 1073741824 Nov 05 03:55:30 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:30 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Created reservations ['2abcce06-26c4-49dd-be4f-e2010f11f840', '1e721b5f-923e-4273-8602-89a0370e33f0', 'd951e7a6-331a-46b7-9cf5-cf59c859091f', '9cd09dc3-8747-4f3c-9638-ed9352294aa9'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:31 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:31 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "cinder-e4adaf05-829b-4796-8681-ee4f1b705230-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-e4adaf05-829b-4796-8681-ee4f1b705230-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "cinder-quobyte-e4adaf05-829b-4796-8681-ee4f1b705230" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-quobyte-e4adaf05-829b-4796-8681-ee4f1b705230" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a6aec3-f2ab-4966-a73c-f1149922aeb0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:31 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.351s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Deleted volume successfully. Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-38cd033c-ae9c-4559-b43b-5464c9c8cb9a tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-865b73dd-9c14-409a-801b-036751d8a117-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:31 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 1073741824" returned: 0 in 0.615s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:31 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 Nov 05 03:55:31 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:31 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 Nov 05 03:55:31 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:31 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230" returned: 0 in 0.422s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:31 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84" returned: 0 in 0.300s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:31 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230 Nov 05 03:55:31 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3846a30b-2084-47c0-aab3-e3e8943e9f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7c6402-7f75-40e2-b472-27aba4a74c84', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68655664-80b0-4006-8c49-8d058e19e704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:31 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Volume volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 (7c7c6402-7f75-40e2-b472-27aba4a74c84): created successfully Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68655664-80b0-4006-8c49-8d058e19e704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Flow 'volume_create_manager' (bced5a22-6046-464b-b1d3-22429cdef485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a832dd17-3bb5-408f-a6c6-db414c703064 tempest-VolumeDependencyTests-1257363700 None] Created volume successfully. Nov 05 03:55:32 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-e4adaf05-829b-4796-8681-ee4f1b705230" returned: 0 in 0.276s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-quobyte-e4adaf05-829b-4796-8681-ee4f1b705230" released by "delete_volume" :: held 0.748s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Created reservations ['bb613d74-7f4a-40f7-a5e2-91783c1ec1b3', '102a75bd-f125-43a0-81a2-1423b2b527fe', '1787000a-6ab4-47ec-8ff7-0e8efc5cfde3', 'cb32cb2f-03b2-4623-a3f1-871f29821105'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:32 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:32 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Flow 'volume_create_manager' (d7e0e3b6-d5b2-4781-bea4-33d7c335c315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec7a584-9724-4d3c-8cd3-d50754591516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec7a584-9724-4d3c-8cd3-d50754591516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-446386219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5e9a12-252d-46ce-83ef-706fbf59a7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9b93db933f4707af116fdb35947452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:32Z,use_quota=True,user_id='c6cb64b8b7e44bdc928e95cfc1c513f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2e785a-33ed-4d8d-a1b4-45542ed68d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2e785a-33ed-4d8d-a1b4-45542ed68d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b35b4d8-a89e-47cd-8c66-8c75aed46a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b35b4d8-a89e-47cd-8c66-8c75aed46a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e5e9a12-252d-46ce-83ef-706fbf59a7b7', 'volume_name': 'volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e5185e-8cfc-4208-8e96-20fa208d3ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e5185e-8cfc-4208-8e96-20fa208d3ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b64cd-132d-4fa2-9125-f6b927bf2b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:32 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Volume 9e5e9a12-252d-46ce-83ef-706fbf59a7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7', 'volume_size': 1} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-446386219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5e9a12-252d-46ce-83ef-706fbf59a7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9b93db933f4707af116fdb35947452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:32Z,use_quota=True,user_id='c6cb64b8b7e44bdc928e95cfc1c513f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Creating volume 9e5e9a12-252d-46ce-83ef-706fbf59a7b7 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:32 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:32 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.306s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Deleted volume successfully. Nov 05 03:55:32 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 1073741824 Nov 05 03:55:32 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ffd74bbe-19bc-44a0-8e2b-cb1f785888f4 tempest-VolumesListTestJSON-2065991928 None] Lock "cinder-e4adaf05-829b-4796-8681-ee4f1b705230-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:33 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 1073741824" returned: 0 in 0.595s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:33 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 Nov 05 03:55:33 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:33 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7" returned: 0 in 0.256s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.361s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Creating offline snapshot 7d029850-cf84-41b6-a4b0-48b93d4162e0 of volume 7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b64cd-132d-4fa2-9125-f6b927bf2b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce367fd1-d26e-4aaf-8e26-00f33c17b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee646d8-3fd7-409d-a334-1e6e6c7beb6c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:33 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Volume volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 (9e5e9a12-252d-46ce-83ef-706fbf59a7b7): created successfully Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce367fd1-d26e-4aaf-8e26-00f33c17b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Flow 'volume_create_manager' (d7e0e3b6-d5b2-4781-bea4-33d7c335c315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:33 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-684f6bde-5b71-41c8-8305-afbbea3f0b86 tempest-VolumesTransfersV357Test-165446703 None] Created volume successfully. Nov 05 03:55:33 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 Nov 05 03:55:33 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:33 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84" returned: 0 in 0.408s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:33 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 1G Nov 05 03:55:33 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:34 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 1G" returned: 0 in 0.451s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:34 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 Nov 05 03:55:34 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:34 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0" returned: 0 in 0.386s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:34 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 is being set with open permissions: ugo+rw Nov 05 03:55:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:34 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 Nov 05 03:55:34 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:35 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0" returned: 0 in 0.297s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:35 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.info Nov 05 03:55:35 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:35 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.info" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:35 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.info is being set with open permissions: ugo+rw Nov 05 03:55:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:35 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.info Nov 05 03:55:35 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:35 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-43e7d8bf-95c5-4261-841f-1a632ed9b87a tempest-VolumesTransfersV357Test-2135598805 None] Transfer volume completed successfully. Nov 05 03:55:35 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.info" returned: 0 in 0.286s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.269s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:35 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d66d301d-25ff-4534-88cd-e56d0264412b tempest-VolumeDependencyTests-1257363700 None] Create snapshot completed successfully Nov 05 03:55:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Acquiring lock "cinder-9e5e9a12-252d-46ce-83ef-706fbf59a7b7-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Lock "cinder-9e5e9a12-252d-46ce-83ef-706fbf59a7b7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Acquiring lock "cinder-quobyte-9e5e9a12-252d-46ce-83ef-706fbf59a7b7" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Lock "cinder-quobyte-9e5e9a12-252d-46ce-83ef-706fbf59a7b7" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:36 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1245612-5c83-4ee8-86b3-8a5f80f42c26]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:36 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 Nov 05 03:55:36 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:36 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7" returned: 0 in 0.515s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:36 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7 Nov 05 03:55:36 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Flow 'volume_create_manager' (2c916d4f-9a0e-4e57-a209-3d97810fb6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0219161b-6ba9-4af5-b79f-70a745d8e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0219161b-6ba9-4af5-b79f-70a745d8e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-225872615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28aacd2-c4dd-48f7-9553-20ad67057de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d0ca2657ba4248b7bff58a644f5436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d029850-cf84-41b6-a4b0-48b93d4162e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:37Z,use_quota=True,user_id='76427e8c79ba4c4687067f4ae2cdfd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ac4a2c-0eef-4b3b-a391-c4ba79e10b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ac4a2c-0eef-4b3b-a391-c4ba79e10b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e21463-71de-4764-a324-2844e11a0acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e21463-71de-4764-a324-2844e11a0acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b28aacd2-c4dd-48f7-9553-20ad67057de3', 'volume_name': 'volume-b28aacd2-c4dd-48f7-9553-20ad67057de3', 'volume_size': 1, 'snapshot_id': '7d029850-cf84-41b6-a4b0-48b93d4162e0'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0268ed2e-6e6f-45d0-a970-32d420d0048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0268ed2e-6e6f-45d0-a970-32d420d0048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4dc481-30fa-4355-9177-417da8ec8fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:37 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Volume b28aacd2-c4dd-48f7-9553-20ad67057de3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b28aacd2-c4dd-48f7-9553-20ad67057de3', 'volume_size': 1, 'snapshot_id': '7d029850-cf84-41b6-a4b0-48b93d4162e0'} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-quobyte-7d029850-cf84-41b6-a4b0-48b93d4162e0-b28aacd2-c4dd-48f7-9553-20ad67057de3" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-7d029850-cf84-41b6-a4b0-48b93d4162e0-b28aacd2-c4dd-48f7-9553-20ad67057de3" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Creating volume b28aacd2-c4dd-48f7-9553-20ad67057de3 from snapshot 7d029850-cf84-41b6-a4b0-48b93d4162e0 {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-quobyte-b28aacd2-c4dd-48f7-9553-20ad67057de3" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:37 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-b28aacd2-c4dd-48f7-9553-20ad67057de3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] snapshot: 7d029850-cf84-41b6-a4b0-48b93d4162e0, volume: b28aacd2-c4dd-48f7-9553-20ad67057de3, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e5e9a12-252d-46ce-83ef-706fbf59a7b7" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Lock "cinder-quobyte-9e5e9a12-252d-46ce-83ef-706fbf59a7b7" released by "delete_volume" :: held 0.940s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad19aa68-66e1-4f94-9285-ac8fee5b52e5]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Created reservations ['5894ce58-1209-4ce0-a820-1da5f13f1af7', '5f87802e-fd80-4bd2-881a-ae2613e20c0a', 'ea525b01-57be-48ff-b27c-d660132edacd', 'd3b061e4-b107-415e-b1f2-3cf24b1c9d83'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:37 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 Nov 05 03:55:37 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:37 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:37 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:37 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Deleted volume successfully. Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-42d74f7b-8785-4480-a932-f39579b28761 tempest-VolumesTransfersV357Test-1071362556 None] Lock "cinder-9e5e9a12-252d-46ce-83ef-706fbf59a7b7-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:37 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0" returned: 0 in 0.491s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c7c6402-7f75-40e2-b472-27aba4a74c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0ca4e-de2c-409b-bda3-ea22f3d9aec4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:37 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 Nov 05 03:55:37 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:38 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84" returned: 0 in 0.457s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:55:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:55:38 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:55:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:38 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 Nov 05 03:55:38 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Flow 'volume_create_manager' (61080787-7691-4977-87f4-7b83f113cc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c1adfd-8c02-4d7a-9002-df2bfc98e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c1adfd-8c02-4d7a-9002-df2bfc98e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-446478903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da177acb-dc83-4fd6-93a7-f174c7514e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9b93db933f4707af116fdb35947452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:40Z,use_quota=True,user_id='c6cb64b8b7e44bdc928e95cfc1c513f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2167fc8b-8d3e-4771-8e04-ec5341acfac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2167fc8b-8d3e-4771-8e04-ec5341acfac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10ca1e9-8a6b-48f0-9ac8-4cca1bf2d23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10ca1e9-8a6b-48f0-9ac8-4cca1bf2d23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da177acb-dc83-4fd6-93a7-f174c7514e03', 'volume_name': 'volume-da177acb-dc83-4fd6-93a7-f174c7514e03', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b527ab27-2b54-4f2e-8269-bcd4904c58f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b527ab27-2b54-4f2e-8269-bcd4904c58f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93f1ebb-caef-43f8-be92-9170aa8b82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:39 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Volume da177acb-dc83-4fd6-93a7-f174c7514e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da177acb-dc83-4fd6-93a7-f174c7514e03', 'volume_size': 1} Nov 05 03:55:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:46 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3" returned: 0 in 8.433s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:46 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:55:46 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Converted 1024.00 MB image at 121.42 MB/s Nov 05 03:55:46 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 is being set with open permissions: ugo+rw Nov 05 03:55:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:46 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 Nov 05 03:55:46 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:47 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3" returned: 0 in 0.286s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-b28aacd2-c4dd-48f7-9553-20ad67057de3" released by "_copy_volume_from_snapshot" :: held 9.777s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=133,cinder:UPDATE=138,cinder:DELETE=10,cinder:INSERT=37 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=120,cinder:INSERT=30,cinder:UPDATE=151,cinder:DELETE=14 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-7d029850-cf84-41b6-a4b0-48b93d4162e0-b28aacd2-c4dd-48f7-9553-20ad67057de3" released by "_create_volume_from_snapshot" :: held 9.886s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.912s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.135s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-446478903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da177acb-dc83-4fd6-93a7-f174c7514e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9b93db933f4707af116fdb35947452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:40Z,use_quota=True,user_id='c6cb64b8b7e44bdc928e95cfc1c513f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Creating volume da177acb-dc83-4fd6-93a7-f174c7514e03 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:47 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:47 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 1073741824 Nov 05 03:55:47 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4dc481-30fa-4355-9177-417da8ec8fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28aacd2-c4dd-48f7-9553-20ad67057de3', 'volume_size': 1, 'snapshot_id': '7d029850-cf84-41b6-a4b0-48b93d4162e0'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621d3eba-f9ca-4280-81da-7fe96c1c65c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:47 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Volume volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 (b28aacd2-c4dd-48f7-9553-20ad67057de3): created successfully Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621d3eba-f9ca-4280-81da-7fe96c1c65c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Flow 'volume_create_manager' (2c916d4f-9a0e-4e57-a209-3d97810fb6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:47 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ae2c9d5a-64b3-4a23-aef4-25d6e241c2ec tempest-VolumeDependencyTests-1257363700 None] Created volume successfully. Nov 05 03:55:47 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 1073741824" returned: 0 in 0.508s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:47 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 Nov 05 03:55:47 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:47 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03" returned: 0 in 0.309s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93f1ebb-caef-43f8-be92-9170aa8b82c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da177acb-dc83-4fd6-93a7-f174c7514e03', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b0d11d-2b82-4c81-a699-fbb7feabe554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:47 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Volume volume-da177acb-dc83-4fd6-93a7-f174c7514e03 (da177acb-dc83-4fd6-93a7-f174c7514e03): created successfully Nov 05 03:55:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b0d11d-2b82-4c81-a699-fbb7feabe554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Flow 'volume_create_manager' (61080787-7691-4977-87f4-7b83f113cc66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-597bb2f4-2a4b-4933-b16a-335b57ee2b0f tempest-VolumesTransfersV357Test-165446703 None] Created volume successfully. Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-7d029850-cf84-41b6-a4b0-48b93d4162e0-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-7d029850-cf84-41b6-a4b0-48b93d4162e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-quobyte-7c7c6402-7f75-40e2-b472-27aba4a74c84" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-7c7c6402-7f75-40e2-b472-27aba4a74c84" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-quobyte-7d029850-cf84-41b6-a4b0-48b93d4162e0" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-7d029850-cf84-41b6-a4b0-48b93d4162e0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Deleting offline snapshot 7d029850-cf84-41b6-a4b0-48b93d4162e0 of volume 7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] snapshot_file for this snap is: volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c93d305-ee3c-4272-a84a-71406801abeb]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:48 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 Nov 05 03:55:48 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:48 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0" returned: 0 in 0.468s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c7c6402-7f75-40e2-b472-27aba4a74c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Acquiring lock "cinder-da177acb-dc83-4fd6-93a7-f174c7514e03-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[92457c59-129c-42f9-9377-0e7bcc98a452]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Lock "cinder-da177acb-dc83-4fd6-93a7-f174c7514e03-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Acquiring lock "cinder-quobyte-da177acb-dc83-4fd6-93a7-f174c7514e03" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Lock "cinder-quobyte-da177acb-dc83-4fd6-93a7-f174c7514e03" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ecda3-a01b-4c3a-8883-b010bfa8689b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:48 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 Nov 05 03:55:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:48 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:49 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 Nov 05 03:55:49 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:49 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03" returned: 0 in 0.624s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:49 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:49 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03 Nov 05 03:55:49 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84" returned: 0 in 0.881s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:49 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 Nov 05 03:55:49 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:50 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da177acb-dc83-4fd6-93a7-f174c7514e03" returned: 0 in 0.467s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Lock "cinder-quobyte-da177acb-dc83-4fd6-93a7-f174c7514e03" released by "delete_volume" :: held 1.167s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Created reservations ['43f6c967-0441-40a7-802a-c8157c1ad497', '67df5503-465b-46eb-aedf-96cdc3d53d25', '8223a8fd-d37a-4c17-808a-221cf0d0da25', '2a6a934f-77ff-4353-80e4-98fc76169e45'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:50 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0" returned: 0 in 0.524s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:50 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0 Nov 05 03:55:50 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:50 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:50 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:50 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84.7d029850-cf84-41b6-a4b0-48b93d4162e0" returned: 0 in 0.314s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-7d029850-cf84-41b6-a4b0-48b93d4162e0" released by "_delete_snapshot" :: held 2.382s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-7c7c6402-7f75-40e2-b472-27aba4a74c84" released by "delete_snapshot" :: held 2.417s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:50 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.356s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Deleted volume successfully. Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-722ab117-5ef3-4fc5-a763-0ffca265a6d3 tempest-VolumesTransfersV357Test-1071362556 None] Lock "cinder-da177acb-dc83-4fd6-93a7-f174c7514e03-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Created reservations ['1b3e69d6-e461-41f9-9cdb-80ee430f3ca1', '9a11e691-7281-48ba-845f-b50218453b9e', '66267cf5-b1f3-4f79-b0b8-726d6edb7146', 'f8c64046-0f68-449b-8218-402377fc7236'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Delete snapshot completed successfully. Nov 05 03:55:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-623161c9-d7e1-4cf2-bf66-430f59c84869 tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-7d029850-cf84-41b6-a4b0-48b93d4162e0-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-7c7c6402-7f75-40e2-b472-27aba4a74c84-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-7c7c6402-7f75-40e2-b472-27aba4a74c84-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-quobyte-7c7c6402-7f75-40e2-b472-27aba4a74c84" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-7c7c6402-7f75-40e2-b472-27aba4a74c84" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:51 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ac096a-a31e-4682-9d10-3ee56685d7cf]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:51 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 Nov 05 03:55:51 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:52 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84" returned: 0 in 0.515s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:52 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84 Nov 05 03:55:52 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:52 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c7c6402-7f75-40e2-b472-27aba4a74c84" returned: 0 in 0.418s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-7c7c6402-7f75-40e2-b472-27aba4a74c84" released by "delete_volume" :: held 1.041s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Created reservations ['0b1e8998-0047-433a-9386-30492dddb5fd', '520de979-8b14-4479-a87d-6747dec6c226', 'b7dc6a06-c5b1-45c1-b1a0-e8b662596145', 'cb3d0d16-e4fb-4eb7-94e6-c94da62e56ea'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:52 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:52 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:53 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.267s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:53 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Deleted volume successfully. Nov 05 03:55:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f1e6e8c0-eba4-4693-b632-bd7e6c07c54a tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-7c7c6402-7f75-40e2-b472-27aba4a74c84-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-b28aacd2-c4dd-48f7-9553-20ad67057de3-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-b28aacd2-c4dd-48f7-9553-20ad67057de3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "cinder-quobyte-b28aacd2-c4dd-48f7-9553-20ad67057de3" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-b28aacd2-c4dd-48f7-9553-20ad67057de3" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd3d0ed-7a98-46b9-afc3-6e58583e013c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:54 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 Nov 05 03:55:54 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:54 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3" returned: 0 in 0.433s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:54 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3 Nov 05 03:55:54 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:54 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b28aacd2-c4dd-48f7-9553-20ad67057de3" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-quobyte-b28aacd2-c4dd-48f7-9553-20ad67057de3" released by "delete_volume" :: held 0.828s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Created reservations ['b1cf9ab6-848a-4f7f-baec-beb28978a914', 'f4eb4a56-f4f8-482b-b3bb-314ea107c6d0', '0559bcda-cfe9-449d-bade-a90e9a6f848c', '0f0a2a9c-58fb-4346-8716-e2901ccdd881'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:55 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:55:55 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:55 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.322s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:55 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Deleted volume successfully. Nov 05 03:55:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7fc07276-7ee9-40ed-98d1-694ce606042f tempest-VolumeDependencyTests-1257363700 None] Lock "cinder-b28aacd2-c4dd-48f7-9553-20ad67057de3-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Flow 'volume_create_manager' (26988b30-3921-4481-bb22-c265c944151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f6fd54-5991-4090-8bff-16eff291e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f6fd54-5991-4090-8bff-16eff291e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-380116651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb77ec8f-f006-41fe-903f-253e15e74728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb5db51a20440688e40318afb52c6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:01Z,use_quota=True,user_id='67a90c8e246b426f8a576cf241a1394d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df088ed-af27-4128-a253-3b8130752191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df088ed-af27-4128-a253-3b8130752191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85957d1d-46c1-4984-87f9-a6a17384b2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85957d1d-46c1-4984-87f9-a6a17384b2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb77ec8f-f006-41fe-903f-253e15e74728', 'volume_name': 'volume-cb77ec8f-f006-41fe-903f-253e15e74728', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80264782-80ee-4dfd-8d96-86b807e5ac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80264782-80ee-4dfd-8d96-86b807e5ac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d9a6d0-7460-4ee1-8166-92968dc8a9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:01 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Volume cb77ec8f-f006-41fe-903f-253e15e74728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb77ec8f-f006-41fe-903f-253e15e74728', 'volume_size': 1} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-380116651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb77ec8f-f006-41fe-903f-253e15e74728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb5db51a20440688e40318afb52c6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:01Z,use_quota=True,user_id='67a90c8e246b426f8a576cf241a1394d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Creating volume cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:56:01 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:01 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 1073741824 Nov 05 03:56:01 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:01 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 1073741824" returned: 0 in 0.683s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:02 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 Nov 05 03:56:02 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:02 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728" returned: 0 in 0.339s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:56:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d9a6d0-7460-4ee1-8166-92968dc8a9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb77ec8f-f006-41fe-903f-253e15e74728', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7e74a6-37cd-455d-a00b-3311afd711e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:02 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Volume volume-cb77ec8f-f006-41fe-903f-253e15e74728 (cb77ec8f-f006-41fe-903f-253e15e74728): created successfully Nov 05 03:56:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7e74a6-37cd-455d-a00b-3311afd711e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Flow 'volume_create_manager' (26988b30-3921-4481-bb22-c265c944151c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-52ebde7d-e45d-4723-80e1-7f9f358a3230 tempest-VolumesCloneTest-312053548 None] Created volume successfully. Nov 05 03:56:03 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Flow 'volume_create_manager' (f117395c-08b0-4b9a-9685-91487748fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0e08a7-d070-4f81-bab6-80b70efc6650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0e08a7-d070-4f81-bab6-80b70efc6650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1006885155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c45556e-89b3-49c9-9db5-780ba53658f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a00c36ec8b64380957ba90fd973b41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:04Z,use_quota=True,user_id='494a2929d68f41918fcb5da9c53d70e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9db5f9-2260-40b0-8a32-f8e7325b1077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9db5f9-2260-40b0-8a32-f8e7325b1077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204315c6-3910-413b-bc34-cb722b104f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204315c6-3910-413b-bc34-cb722b104f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c45556e-89b3-49c9-9db5-780ba53658f7', 'volume_name': 'volume-5c45556e-89b3-49c9-9db5-780ba53658f7', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c812228-f7d2-49d3-8f29-d96e11edd55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c812228-f7d2-49d3-8f29-d96e11edd55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7714e4b2-07a6-44a8-8a0d-1a5956bc169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Volume 5c45556e-89b3-49c9-9db5-780ba53658f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c45556e-89b3-49c9-9db5-780ba53658f7', 'volume_size': 1} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1006885155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c45556e-89b3-49c9-9db5-780ba53658f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a00c36ec8b64380957ba90fd973b41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:04Z,use_quota=True,user_id='494a2929d68f41918fcb5da9c53d70e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Creating volume 5c45556e-89b3-49c9-9db5-780ba53658f7 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:56:04 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:04 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 1073741824 Nov 05 03:56:04 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Flow 'volume_create_manager' (bea3f646-b64f-46a4-90fe-006aed8161f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24985f48-7729-412f-97b4-d53252c1b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24985f48-7729-412f-97b4-d53252c1b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1215720919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabf03fa-da51-45ef-b7bf-590bb0714cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb5db51a20440688e40318afb52c6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=cb77ec8f-f006-41fe-903f-253e15e74728,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:04Z,use_quota=True,user_id='67a90c8e246b426f8a576cf241a1394d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfa9939-37cb-4852-903f-67c75602bafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfa9939-37cb-4852-903f-67c75602bafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0635590a-f171-4ff3-b498-afd7cc81b127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0635590a-f171-4ff3-b498-afd7cc81b127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'aabf03fa-da51-45ef-b7bf-590bb0714cf1', 'volume_name': 'volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1', 'volume_size': 2, 'source_volid': 'cb77ec8f-f006-41fe-903f-253e15e74728', 'source_volstatus': 'available'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b44d515-a780-4371-aa83-1f889b929151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b44d515-a780-4371-aa83-1f889b929151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5ed139-0df1-46c6-b998-b79b2f7af0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Volume aabf03fa-da51-45ef-b7bf-590bb0714cf1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1', 'volume_size': 2, 'source_volid': 'cb77ec8f-f006-41fe-903f-253e15e74728', 'source_volstatus': 'available'} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:04 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 1073741824" returned: 0 in 0.464s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:04 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 Nov 05 03:56:04 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:04 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7" returned: 0 in 0.250s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.543s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:04 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Cloning volume cb77ec8f-f006-41fe-903f-253e15e74728 to volume aabf03fa-da51-45ef-b7bf-590bb0714cf1 Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7714e4b2-07a6-44a8-8a0d-1a5956bc169d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c45556e-89b3-49c9-9db5-780ba53658f7', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf902656-4f86-487d-aa3c-2c18e58a6460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Volume volume-5c45556e-89b3-49c9-9db5-780ba53658f7 (5c45556e-89b3-49c9-9db5-780ba53658f7): created successfully Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf902656-4f86-487d-aa3c-2c18e58a6460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Flow 'volume_create_manager' (f117395c-08b0-4b9a-9685-91487748fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Creating offline snapshot 9c5a1969-d235-4f10-8503-072b3cd5cb14 of volume cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:56:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-33286be6-ab2b-49b8-9484-297db5a09405 tempest-TestImageHashVerification-1987329917 None] Created volume successfully. Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8887bec2-b822-4a8c-a752-c51feb187bb0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:05 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 Nov 05 03:56:05 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:05 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728" returned: 0 in 0.430s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:05 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 1G Nov 05 03:56:05 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:05 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 1G" returned: 0 in 0.414s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb77ec8f-f006-41fe-903f-253e15e74728 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:05 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb77ec8f-f006-41fe-903f-253e15e74728 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 Nov 05 03:56:05 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:06 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb77ec8f-f006-41fe-903f-253e15e74728 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14" returned: 0 in 0.336s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:06 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 is being set with open permissions: ugo+rw Nov 05 03:56:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:06 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 Nov 05 03:56:06 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:06 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14" returned: 0 in 0.296s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:06 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.info Nov 05 03:56:06 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:06 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.info" returned: 0 in 0.281s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:06 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.info is being set with open permissions: ugo+rw Nov 05 03:56:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:06 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.info Nov 05 03:56:06 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:07 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.info" returned: 0 in 0.321s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Acquiring lock "cinder-quobyte-aabf03fa-da51-45ef-b7bf-590bb0714cf1" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Lock "cinder-quobyte-aabf03fa-da51-45ef-b7bf-590bb0714cf1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] snapshot: 9c5a1969-d235-4f10-8503-072b3cd5cb14, volume: aabf03fa-da51-45ef-b7bf-590bb0714cf1, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b01326-4703-4bb9-9b03-2cd2696e079f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:07 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 Nov 05 03:56:07 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:07 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14" returned: 0 in 0.438s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb77ec8f-f006-41fe-903f-253e15e74728(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[23332807-254d-4e1f-bb36-562987f9776f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:07 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 Nov 05 03:56:07 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:07 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728" returned: 0 in 0.379s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:56:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:08 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 Nov 05 03:56:08 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:15 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:56:15 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:15 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:56:15 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1" returned: 0 in 7.776s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:56:15 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Converted 1024.00 MB image at 131.67 MB/s Nov 05 03:56:15 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 is being set with open permissions: ugo+rw Nov 05 03:56:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:15 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 Nov 05 03:56:15 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:16 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1" returned: 0 in 0.289s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Lock "cinder-quobyte-aabf03fa-da51-45ef-b7bf-590bb0714cf1" released by "_copy_volume_from_snapshot" :: held 8.989s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Acquiring lock "cinder-quobyte-9c5a1969-d235-4f10-8503-072b3cd5cb14" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Lock "cinder-quobyte-9c5a1969-d235-4f10-8503-072b3cd5cb14" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Deleting offline snapshot 9c5a1969-d235-4f10-8503-072b3cd5cb14 of volume cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] snapshot_file for this snap is: volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaa90f7-0da4-4bcb-8dc0-e5601b3b39ed]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:16 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 Nov 05 03:56:16 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=29,cinder:UPDATE=43,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:56:16 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14" returned: 0 in 0.394s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb77ec8f-f006-41fe-903f-253e15e74728(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1066cc-e72c-453f-a542-f8917642d934]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:16 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 Nov 05 03:56:16 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:17 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728" returned: 0 in 0.613s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:17 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 Nov 05 03:56:17 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:17 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14" returned: 0 in 0.451s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:17 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14 Nov 05 03:56:17 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:17 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728.9c5a1969-d235-4f10-8503-072b3cd5cb14" returned: 0 in 0.244s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Lock "cinder-quobyte-9c5a1969-d235-4f10-8503-072b3cd5cb14" released by "_delete_snapshot" :: held 1.826s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.131s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 10.658s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5ed139-0df1-46c6-b998-b79b2f7af0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1', 'volume_size': 2, 'source_volid': 'cb77ec8f-f006-41fe-903f-253e15e74728', 'source_volstatus': 'available'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a761ce7-95e5-43cc-8de8-06c5ab452b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed44bd8-836d-440e-bc11-266395899c7b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:18 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Volume volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 (aabf03fa-da51-45ef-b7bf-590bb0714cf1): created successfully Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a761ce7-95e5-43cc-8de8-06c5ab452b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Flow 'volume_create_manager' (bea3f646-b64f-46a4-90fe-006aed8161f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3131c7fc-b8ac-49bb-b8a7-343e07d66603 tempest-VolumesCloneTest-312053548 None] Created volume successfully. Nov 05 03:56:18 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 Nov 05 03:56:18 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:18 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7" returned: 0 in 0.481s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd6157c-4162-4fee-83a3-93b067f1e20c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:18 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 Nov 05 03:56:18 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Acquiring lock "cinder-aabf03fa-da51-45ef-b7bf-590bb0714cf1-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Lock "cinder-aabf03fa-da51-45ef-b7bf-590bb0714cf1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Acquiring lock "cinder-quobyte-aabf03fa-da51-45ef-b7bf-590bb0714cf1" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Lock "cinder-quobyte-aabf03fa-da51-45ef-b7bf-590bb0714cf1" acquired by "delete_volume" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[12510746-e6ca-405c-903d-064a7fe34ce4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:18 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:19 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 Nov 05 03:56:19 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7" returned: 0 in 0.500s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 /opt/stack/data/cinder/conversion/5c45556e-89b3-49c9-9db5-780ba53658f7.temp_image.82ae86c6-4e16-4066-9f9f-442ebdc7fd5dsmvrgmw9.img {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:19 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 /opt/stack/data/cinder/conversion/5c45556e-89b3-49c9-9db5-780ba53658f7.temp_image.82ae86c6-4e16-4066-9f9f-442ebdc7fd5dsmvrgmw9.img Nov 05 03:56:19 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:19 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1" returned: 0 in 0.467s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:19 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1 Nov 05 03:56:19 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:20 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-aabf03fa-da51-45ef-b7bf-590bb0714cf1" returned: 0 in 0.703s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Lock "cinder-quobyte-aabf03fa-da51-45ef-b7bf-590bb0714cf1" released by "delete_volume" :: held 1.245s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Created reservations ['c77361ad-e4c6-469f-9b4e-bd1f1c33f0e3', 'a7e36546-c2a5-4019-bc00-c1a607600e44', 'c010b7b6-56e2-459f-8fde-b963ee28395b', 'b67a3ff6-684e-402e-bbc8-4132cf78902f'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:20 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:56:20 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:20 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.624s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:20 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Deleted volume successfully. Nov 05 03:56:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-010d66b3-b275-4cce-a867-597501a96996 tempest-VolumesCloneTest-312053548 None] Lock "cinder-aabf03fa-da51-45ef-b7bf-590bb0714cf1-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Acquiring lock "cinder-cb77ec8f-f006-41fe-903f-253e15e74728-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Lock "cinder-cb77ec8f-f006-41fe-903f-253e15e74728-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Acquiring lock "cinder-quobyte-cb77ec8f-f006-41fe-903f-253e15e74728" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Lock "cinder-quobyte-cb77ec8f-f006-41fe-903f-253e15e74728" acquired by "delete_volume" :: waited 0.042s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:21 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdcf737-dd1b-457a-a0e4-805575591170]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:21 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 Nov 05 03:56:21 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:22 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728" returned: 0 in 0.851s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:22 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728 Nov 05 03:56:22 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:22 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cb77ec8f-f006-41fe-903f-253e15e74728" returned: 0 in 0.501s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Lock "cinder-quobyte-cb77ec8f-f006-41fe-903f-253e15e74728" released by "delete_volume" :: held 1.573s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Created reservations ['9c3e80c4-2778-44ed-8521-d04a62418d86', '53d861cf-ca89-4698-8ccc-b0afa0d69df2', '0242b055-1627-49be-8d0c-9d4d371416cf', '8e66723d-ae97-44d9-a1ec-d75e083998c7'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:23 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:56:23 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:23 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.509s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:23 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Deleted volume successfully. Nov 05 03:56:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a4a727ee-99f6-4f52-9baf-09847c05c904 tempest-VolumesCloneTest-312053548 None] Lock "cinder-cb77ec8f-f006-41fe-903f-253e15e74728-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:27 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 /opt/stack/data/cinder/conversion/5c45556e-89b3-49c9-9db5-780ba53658f7.temp_image.82ae86c6-4e16-4066-9f9f-442ebdc7fd5dsmvrgmw9.img" returned: 0 in 8.157s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:27 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f3c0f-d29c-4647-aeaa-5dbbdd40d98c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:27 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 Nov 05 03:56:27 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:27 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7" returned: 0 in 0.710s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:27 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/conversion/5c45556e-89b3-49c9-9db5-780ba53658f7.temp_image.82ae86c6-4e16-4066-9f9f-442ebdc7fd5dsmvrgmw9.img {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:56:27 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Converted 1024.00 MB image at 125.51 MB/s Nov 05 03:56:27 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] 82ae86c6-4e16-4066-9f9f-442ebdc7fd5d was raw, no need to convert to raw {{(pid=87111) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Flow 'volume_create_manager' (bd77dabc-d935-4b5c-966e-489fa67fc63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20062dc8-efe8-46b9-87df-0bc8b05d9430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20062dc8-efe8-46b9-87df-0bc8b05d9430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-106681596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781d3f5e-34fa-4a32-9ca8-78e8ebe334bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea7052a9ea54701b09dc39f586ad0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:31Z,use_quota=True,user_id='b6cbdcc287f7485c98109507fe66e97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff579821-16fd-4f25-9d68-c90a19b8f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff579821-16fd-4f25-9d68-c90a19b8f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3897de2e-463e-445d-81c1-5b399fe98085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3897de2e-463e-445d-81c1-5b399fe98085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781d3f5e-34fa-4a32-9ca8-78e8ebe334bb', 'volume_name': 'volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb', 'volume_size': 2}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847316d4-131f-400a-a9bd-50dde1065f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847316d4-131f-400a-a9bd-50dde1065f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7a2067-643f-4a08-8459-c47054db6a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:31 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Volume 781d3f5e-34fa-4a32-9ca8-78e8ebe334bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb', 'volume_size': 2} Nov 05 03:56:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Flow 'volume_create_manager' (5e6028b6-4ceb-4809-a09e-7083cca8e337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9a7bf0-de35-4a38-b032-e5d982c7f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9a7bf0-de35-4a38-b032-e5d982c7f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1178307462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22337cbbdcc441de9a3f541fa5387faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:35Z,use_quota=True,user_id='4196c447212f4bc182e858db9a53870f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e756bd3-bd90-45a2-8375-aaa2f9c660e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e756bd3-bd90-45a2-8375-aaa2f9c660e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d224af9e-4086-465a-bf0b-071096603aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d224af9e-4086-465a-bf0b-071096603aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25', 'volume_name': 'volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9eafc3-5e66-43c7-ba71-b85b16b2a297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9eafc3-5e66-43c7-ba71-b85b16b2a297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07ae18d-b936-40ac-82d5-156019c5ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:35 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Volume 7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25', 'volume_size': 1} Nov 05 03:56:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:45 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=55,cinder:INSERT=18,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.212s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Uploaded volume to glance image-id: 82ae86c6-4e16-4066-9f9f-442ebdc7fd5d. {{(pid=87111) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.922s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-106681596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781d3f5e-34fa-4a32-9ca8-78e8ebe334bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea7052a9ea54701b09dc39f586ad0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:31Z,use_quota=True,user_id='b6cbdcc287f7485c98109507fe66e97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Creating volume 781d3f5e-34fa-4a32-9ca8-78e8ebe334bb {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:56:48 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb 2147483648 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:48 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb 2147483648 Nov 05 03:56:48 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7499bef1-5c3e-49e3-9073-45ae953a546d tempest-TestImageHashVerification-1987329917 None] Copy volume to image completed successfully. Nov 05 03:56:48 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb 2147483648" returned: 0 in 0.507s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:48 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb Nov 05 03:56:48 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:48 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb" returned: 0 in 0.252s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.406s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1178307462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22337cbbdcc441de9a3f541fa5387faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:35Z,use_quota=True,user_id='4196c447212f4bc182e858db9a53870f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Creating volume 7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:56:49 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7a2067-643f-4a08-8459-c47054db6a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb', 'volume_size': 2}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:49 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 1073741824 Nov 05 03:56:49 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbff4e5-bb19-4e60-94fc-df0c148589b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:49 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Volume volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb (781d3f5e-34fa-4a32-9ca8-78e8ebe334bb): created successfully Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbff4e5-bb19-4e60-94fc-df0c148589b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Flow 'volume_create_manager' (bd77dabc-d935-4b5c-966e-489fa67fc63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-aeae3145-698b-4c20-95bc-f8dc20130c11 tempest-VolumesCloneNegativeTest-1260522968 None] Created volume successfully. Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Acquiring lock "cinder-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Lock "cinder-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Acquiring lock "cinder-quobyte-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Lock "cinder-quobyte-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d6ad0b-a56f-4ab6-97af-9f5f8214e568]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:49 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 1073741824" returned: 0 in 0.592s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:49 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb Nov 05 03:56:49 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:49 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 Nov 05 03:56:49 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Acquiring lock "cinder-5c45556e-89b3-49c9-9db5-780ba53658f7-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Lock "cinder-5c45556e-89b3-49c9-9db5-780ba53658f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:49 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" returned: 0 in 0.332s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07ae18d-b936-40ac-82d5-156019c5ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:49 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedc6993-3a52-45a9-8d77-8b4ed2253e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb" returned: 0 in 0.474s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Volume volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 (7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25): created successfully Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedc6993-3a52-45a9-8d77-8b4ed2253e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:50 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb Nov 05 03:56:50 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Flow 'volume_create_manager' (5e6028b6-4ceb-4809-a09e-7083cca8e337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Acquiring lock "cinder-quobyte-5c45556e-89b3-49c9-9db5-780ba53658f7" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-88d5e354-5e9b-4648-b854-948125ed1b0a tempest-SnapshotDependencyTests-1222095399 None] Created volume successfully. Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Lock "cinder-quobyte-5c45556e-89b3-49c9-9db5-780ba53658f7" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d4ba4a-be6b-4348-af3b-b6c546f06fc6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:50 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 Nov 05 03:56:50 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:50 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb" returned: 0 in 0.290s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Lock "cinder-quobyte-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb" released by "delete_volume" :: held 0.820s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Created reservations ['d173e8a2-1911-4956-9369-ca5b3c3bef74', '83678ed0-9320-40e8-955b-023f139dd7de', '4d3ac912-7e49-4459-b2aa-52fac8a4b67a', 'c52c9cd5-dd61-4ef9-bb05-9f86b5f684e1'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:50 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:56:50 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:50 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7" returned: 0 in 0.463s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:50 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7 Nov 05 03:56:50 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:50 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.323s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Deleted volume successfully. Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9d5ae342-ac61-45c7-81cc-07ec7886d50c tempest-VolumesCloneNegativeTest-1260522968 None] Lock "cinder-781d3f5e-34fa-4a32-9ca8-78e8ebe334bb-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Creating offline snapshot bc2c1520-293c-4c16-8190-68a4d89b8bd8 of volume 7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[454a604a-5dec-4dee-b4d5-745027e177c8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:50 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5c45556e-89b3-49c9-9db5-780ba53658f7" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Lock "cinder-quobyte-5c45556e-89b3-49c9-9db5-780ba53658f7" released by "delete_volume" :: held 0.839s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:50 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 Nov 05 03:56:50 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Created reservations ['14fb733e-2b48-496f-9461-e6e4ba8b3a35', '52e1d607-2cdb-443c-b4ac-aa613018a453', 'd3461f2f-1aa2-4908-a2de-956e2e5f1b00', '1dfc5d3d-ebb9-4a47-a7de-909edf2b7d8d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:51 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:56:51 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:51 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" returned: 0 in 0.420s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:51 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 1G Nov 05 03:56:51 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:51 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.266s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Deleted volume successfully. Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8dadd28f-7468-4cbc-b423-8c53241c97ec tempest-TestImageHashVerification-1987329917 None] Lock "cinder-5c45556e-89b3-49c9-9db5-780ba53658f7-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:51 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 1G" returned: 0 in 0.457s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:51 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 Nov 05 03:56:51 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:52 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8" returned: 0 in 0.342s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:52 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 is being set with open permissions: ugo+rw Nov 05 03:56:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:52 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 Nov 05 03:56:52 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:52 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8" returned: 0 in 0.324s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:52 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.info Nov 05 03:56:52 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:52 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.info" returned: 0 in 0.317s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:52 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.info is being set with open permissions: ugo+rw Nov 05 03:56:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:52 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.info Nov 05 03:56:52 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:53 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.info" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.391s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-dc9b2670-1844-42bb-ad80-770e0da63d6f tempest-SnapshotDependencyTests-1222095399 None] Create snapshot completed successfully Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Flow 'volume_create_manager' (b155f03e-f704-4e55-aa04-4d05e6db8203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92159242-5fcf-4d98-97e9-c1af6c2aa051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92159242-5fcf-4d98-97e9-c1af6c2aa051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f155207-5651-4a91-b4f9-1691ee27b586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22337cbbdcc441de9a3f541fa5387faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc2c1520-293c-4c16-8190-68a4d89b8bd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:55Z,use_quota=True,user_id='4196c447212f4bc182e858db9a53870f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3dcf68-02ce-47f1-afbe-c55f4a81c52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3dcf68-02ce-47f1-afbe-c55f4a81c52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707b67d2-e515-4eb5-ad30-331eeec6d505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707b67d2-e515-4eb5-ad30-331eeec6d505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f155207-5651-4a91-b4f9-1691ee27b586', 'volume_name': 'volume-6f155207-5651-4a91-b4f9-1691ee27b586', 'volume_size': 1, 'snapshot_id': 'bc2c1520-293c-4c16-8190-68a4d89b8bd8'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a62c9d-7069-4305-947a-bd0425853eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a62c9d-7069-4305-947a-bd0425853eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d158cdc-cc33-4f1f-afe1-6e74db01e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Volume 6f155207-5651-4a91-b4f9-1691ee27b586: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f155207-5651-4a91-b4f9-1691ee27b586', 'volume_size': 1, 'snapshot_id': 'bc2c1520-293c-4c16-8190-68a4d89b8bd8'} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-quobyte-bc2c1520-293c-4c16-8190-68a4d89b8bd8-6f155207-5651-4a91-b4f9-1691ee27b586" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-bc2c1520-293c-4c16-8190-68a4d89b8bd8-6f155207-5651-4a91-b4f9-1691ee27b586" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Creating volume 6f155207-5651-4a91-b4f9-1691ee27b586 from snapshot bc2c1520-293c-4c16-8190-68a4d89b8bd8 {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-quobyte-6f155207-5651-4a91-b4f9-1691ee27b586" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-6f155207-5651-4a91-b4f9-1691ee27b586" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] snapshot: bc2c1520-293c-4c16-8190-68a4d89b8bd8, volume: 6f155207-5651-4a91-b4f9-1691ee27b586, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2e0549-3afe-4d6f-bc37-1b008d3043fe]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:55 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 Nov 05 03:56:55 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (34896a59-fe4f-49da-ad89-302b947ac08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ea669b-c1d0-4c92-9f49-693fe09cdc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ea669b-c1d0-4c92-9f49-693fe09cdc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-56417508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f71bd9-803d-4937-a292-7e06beac4bbd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:55Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff000409-b015-42d5-b2ab-1dd304211f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff000409-b015-42d5-b2ab-1dd304211f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e087ef26-9a45-4215-9cf5-01e33d7ef1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e087ef26-9a45-4215-9cf5-01e33d7ef1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f71bd9-803d-4937-a292-7e06beac4bbd', 'volume_name': 'volume-15f71bd9-803d-4937-a292-7e06beac4bbd', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b097ce2e-f1a9-449a-84fc-a839447e2d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b097ce2e-f1a9-449a-84fc-a839447e2d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc65060-99e2-40b8-bbec-b70a98d15df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:55 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Volume 15f71bd9-803d-4937-a292-7e06beac4bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f71bd9-803d-4937-a292-7e06beac4bbd', 'volume_size': 1} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:55 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8" returned: 0 in 0.437s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b87d446-46dd-4ca7-8b2f-091b12c4a5e1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:55 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 Nov 05 03:56:55 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:55 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" returned: 0 in 0.359s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:56:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:55 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 Nov 05 03:56:55 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:02 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586" returned: 0 in 6.930s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:02 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:57:02 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Converted 1024.00 MB image at 147.75 MB/s Nov 05 03:57:02 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 is being set with open permissions: ugo+rw Nov 05 03:57:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:02 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 Nov 05 03:57:02 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:02 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586" returned: 0 in 0.244s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-6f155207-5651-4a91-b4f9-1691ee27b586" released by "_copy_volume_from_snapshot" :: held 8.070s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-bc2c1520-293c-4c16-8190-68a4d89b8bd8-6f155207-5651-4a91-b4f9-1691ee27b586" released by "_create_volume_from_snapshot" :: held 8.171s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.191s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.660s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-56417508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f71bd9-803d-4937-a292-7e06beac4bbd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:55Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Creating volume 15f71bd9-803d-4937-a292-7e06beac4bbd {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:03 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:03 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd 1073741824 Nov 05 03:57:03 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d158cdc-cc33-4f1f-afe1-6e74db01e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f155207-5651-4a91-b4f9-1691ee27b586', 'volume_size': 1, 'snapshot_id': 'bc2c1520-293c-4c16-8190-68a4d89b8bd8'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a318e36e-e53b-434d-87cc-0507ede553a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Volume volume-6f155207-5651-4a91-b4f9-1691ee27b586 (6f155207-5651-4a91-b4f9-1691ee27b586): created successfully Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a318e36e-e53b-434d-87cc-0507ede553a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Flow 'volume_create_manager' (b155f03e-f704-4e55-aa04-4d05e6db8203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:03 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-03f7ae41-01f9-4d51-a07b-12cf4ca64dcd tempest-SnapshotDependencyTests-1222095399 None] Created volume successfully. Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-bc2c1520-293c-4c16-8190-68a4d89b8bd8-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:03 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd 1073741824" returned: 0 in 0.506s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-bc2c1520-293c-4c16-8190-68a4d89b8bd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-quobyte-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-quobyte-bc2c1520-293c-4c16-8190-68a4d89b8bd8" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-bc2c1520-293c-4c16-8190-68a4d89b8bd8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Deleting offline snapshot bc2c1520-293c-4c16-8190-68a4d89b8bd8 of volume 7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] snapshot_file for this snap is: volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[645c5b03-2636-44e1-a840-e6285039edcd]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:03 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd Nov 05 03:57:03 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:03 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 Nov 05 03:57:03 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:03 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd" returned: 0 in 0.276s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc65060-99e2-40b8-bbec-b70a98d15df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f71bd9-803d-4937-a292-7e06beac4bbd', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413be95e-ff53-44d1-a386-04533cfa8d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Volume volume-15f71bd9-803d-4937-a292-7e06beac4bbd (15f71bd9-803d-4937-a292-7e06beac4bbd): created successfully Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413be95e-ff53-44d1-a386-04533cfa8d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (34896a59-fe4f-49da-ad89-302b947ac08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:03 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-72530d5e-c8f1-4f1b-8b08-0ad670dc7f82 tempest-VolumesGetTest-1041637792 None] Created volume successfully. Nov 05 03:57:04 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8" returned: 0 in 0.430s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:57:04 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5359c334-afa6-488d-98d0-c9bb77d3bbcf]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:04 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 Nov 05 03:57:04 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:04 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" returned: 0 in 0.601s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:04 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 Nov 05 03:57:04 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:05 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8" returned: 0 in 0.390s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:05 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8 Nov 05 03:57:05 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:05 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25.bc2c1520-293c-4c16-8190-68a4d89b8bd8" returned: 0 in 0.327s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-bc2c1520-293c-4c16-8190-68a4d89b8bd8" released by "_delete_snapshot" :: held 1.867s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" released by "delete_snapshot" :: held 1.897s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Created reservations ['29734900-b0ae-4f9a-b5c6-33dc617000c0', 'fcc3f372-5dc6-4c14-8c6f-b9cc699805b3', 'c81d8ed8-5674-4e29-a4d8-ccf8c96d8643', '6ca5a87b-36da-4647-98ae-655963b7797d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:05 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Delete snapshot completed successfully. Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-49c71b1d-d0cc-4ebe-a888-769058a0a959 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-bc2c1520-293c-4c16-8190-68a4d89b8bd8-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-quobyte-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c614adc-c460-464e-8e06-94851ee2ee80]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:06 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 Nov 05 03:57:06 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:06 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" returned: 0 in 0.446s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:06 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25 Nov 05 03:57:06 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (9f172c7f-b406-46ab-95b6-56a5fac67fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7331f550-8013-42ee-b780-60e75c8f15e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7331f550-8013-42ee-b780-60e75c8f15e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1427185639',display_name='tempest-VolumesGetTest-Volume-776852956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8cc08a-a812-4726-bc53-7f3279606915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:06Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f400556-8107-4924-9088-150b529b200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f400556-8107-4924-9088-150b529b200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f701e29-7d8d-4de3-ac0c-c8ba058664b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f701e29-7d8d-4de3-ac0c-c8ba058664b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a8cc08a-a812-4726-bc53-7f3279606915', 'volume_name': 'volume-6a8cc08a-a812-4726-bc53-7f3279606915', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794197ae-ad7f-4c8e-873c-244e6d3f701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794197ae-ad7f-4c8e-873c-244e6d3f701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f171a5-f420-401d-a155-ff95e5d19fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:06 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Volume 6a8cc08a-a812-4726-bc53-7f3279606915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a8cc08a-a812-4726-bc53-7f3279606915', 'volume_size': 1} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1427185639',display_name='tempest-VolumesGetTest-Volume-776852956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8cc08a-a812-4726-bc53-7f3279606915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:06Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Creating volume 6a8cc08a-a812-4726-bc53-7f3279606915 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:06 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:06 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 1073741824 Nov 05 03:57:06 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:06 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" returned: 0 in 0.302s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25" released by "delete_volume" :: held 0.831s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Created reservations ['6bd82ea5-2640-4b66-855f-9cfca6ffcfbd', '37e2c670-54df-46ae-9a99-67f2819065ae', '78cae3f6-6925-4aa5-94bc-d3e857ac976e', 'd1bb2a7c-f6cc-4125-81b0-f3c70b6eb0f1'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:06 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:06 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-6f155207-5651-4a91-b4f9-1691ee27b586-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-6f155207-5651-4a91-b4f9-1691ee27b586-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "cinder-quobyte-6f155207-5651-4a91-b4f9-1691ee27b586" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-6f155207-5651-4a91-b4f9-1691ee27b586" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[87817218-3f8b-483a-a984-f2e3650f7b64]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:07 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 1073741824" returned: 0 in 0.597s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:07 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:07 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 Nov 05 03:57:07 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.398s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:07 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Deleted volume successfully. Nov 05 03:57:07 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 Nov 05 03:57:07 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc0d9910-1924-4dab-9978-507615237494 tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-7a1ad2e4-ae45-472a-bfdb-537b6b9a8f25-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:07 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f171a5-f420-401d-a155-ff95e5d19fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a8cc08a-a812-4726-bc53-7f3279606915', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:07 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf3fe6a-534c-4614-a351-8d03d480c1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586" returned: 0 in 0.470s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:07 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Volume volume-6a8cc08a-a812-4726-bc53-7f3279606915 (6a8cc08a-a812-4726-bc53-7f3279606915): created successfully Nov 05 03:57:07 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586 Nov 05 03:57:07 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf3fe6a-534c-4614-a351-8d03d480c1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (9f172c7f-b406-46ab-95b6-56a5fac67fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:07 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-1b666ff8-6254-4379-8501-3b635edd344b tempest-VolumesGetTest-1041637792 None] Created volume successfully. Nov 05 03:57:07 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6f155207-5651-4a91-b4f9-1691ee27b586" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-quobyte-6f155207-5651-4a91-b4f9-1691ee27b586" released by "delete_volume" :: held 0.828s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:07 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Created reservations ['baf3630e-e2d8-4e4f-84b3-5353fcbf6828', 'b2863481-47ee-47ce-94f7-15be409b2358', '9917f3a6-ce09-4208-a02d-c8827e386bd4', '5bbe2a35-c267-4fab-a25e-572a1801b062'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:08 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:08 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:08 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:08 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Deleted volume successfully. Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-11cf0e32-a64e-4ad8-9aec-55fcff42988b tempest-SnapshotDependencyTests-1222095399 None] Lock "cinder-6f155207-5651-4a91-b4f9-1691ee27b586-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-6a8cc08a-a812-4726-bc53-7f3279606915-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Lock "cinder-6a8cc08a-a812-4726-bc53-7f3279606915-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-6a8cc08a-a812-4726-bc53-7f3279606915" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-6a8cc08a-a812-4726-bc53-7f3279606915" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f48c73-dcc4-44bb-a235-8d333176e79a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:09 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 Nov 05 03:57:09 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:09 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915" returned: 0 in 0.475s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:09 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915 Nov 05 03:57:09 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:09 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6a8cc08a-a812-4726-bc53-7f3279606915" returned: 0 in 0.303s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-6a8cc08a-a812-4726-bc53-7f3279606915" released by "delete_volume" :: held 0.843s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Created reservations ['271bf214-f51f-400d-a00d-e1fb0f4c8cd1', '6fe73794-c351-409c-a306-d7de991479ed', '38e2ae07-0aca-493a-b6d3-9a25c3277029', '3a4e3d27-47e1-4759-a27d-6d54b29ed7fe'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:09 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:09 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-15f71bd9-803d-4937-a292-7e06beac4bbd-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Lock "cinder-15f71bd9-803d-4937-a292-7e06beac4bbd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-15f71bd9-803d-4937-a292-7e06beac4bbd" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-15f71bd9-803d-4937-a292-7e06beac4bbd" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:10 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.392s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Deleted volume successfully. Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc749f75-1b27-4115-bb5a-7cab4e447856]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-44a927b2-19ca-410e-af33-e1b692fa692d tempest-VolumesGetTest-1041637792 None] Lock "cinder-6a8cc08a-a812-4726-bc53-7f3279606915-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:10 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd Nov 05 03:57:10 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:10 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd" returned: 0 in 0.458s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:10 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd Nov 05 03:57:10 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:11 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-15f71bd9-803d-4937-a292-7e06beac4bbd" returned: 0 in 0.303s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-15f71bd9-803d-4937-a292-7e06beac4bbd" released by "delete_volume" :: held 0.824s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Created reservations ['811d9141-d56a-4c93-96e2-2a5652452c70', '45defc4d-5795-40c9-9f71-ee16cc5bff9a', '3496a4cc-dfb9-4bde-991f-7e6e0209c501', '7cd564f8-3af1-4068-a248-d88be6a5b148'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:11 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:11 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:11 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.316s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Deleted volume successfully. Nov 05 03:57:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9f2a8587-c6bf-4270-af90-e26b3dca978b tempest-VolumesGetTest-1041637792 None] Lock "cinder-15f71bd9-803d-4937-a292-7e06beac4bbd-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (6e9a2291-9650-455a-a7d2-022b21fc8a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff79577-4fe9-4fe9-b0e8-d4934caafa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff79577-4fe9-4fe9-b0e8-d4934caafa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1946472171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd88f7f5-138b-4085-9212-6c4802aef120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:12Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812bbca9-3fb7-4939-96f8-4ebe4be3cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812bbca9-3fb7-4939-96f8-4ebe4be3cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb007156-6804-46f6-88f9-8fbe8f3f9628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb007156-6804-46f6-88f9-8fbe8f3f9628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd88f7f5-138b-4085-9212-6c4802aef120', 'volume_name': 'volume-cd88f7f5-138b-4085-9212-6c4802aef120', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faec88c0-0ad3-48a0-aeb7-7d1e98fc6315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faec88c0-0ad3-48a0-aeb7-7d1e98fc6315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b17eed-ba7a-44d6-8429-248b8d6e7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Volume cd88f7f5-138b-4085-9212-6c4802aef120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd88f7f5-138b-4085-9212-6c4802aef120', 'volume_size': 1} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1946472171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd88f7f5-138b-4085-9212-6c4802aef120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:12Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Creating volume cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:12 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:12 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 1073741824 Nov 05 03:57:12 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Flow 'volume_create_manager' (782c9cd9-852d-453e-8acd-a8200b59b1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a614764c-ae5f-4ab5-a28e-ac0decc8d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a614764c-ae5f-4ab5-a28e-ac0decc8d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3d4f91-84f5-498f-8cc5-521c70f10ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d4a63d031748a186390cfa3b11f6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:12Z,use_quota=True,user_id='eaa127bd610f43d081fe68af3cf5da6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(faa571bb-8f03-4e22-be64-8751b25d01e7),volume_type_id=faa571bb-8f03-4e22-be64-8751b25d01e7)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed20350c-b9cf-4529-9f22-6ab55a2fca8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed20350c-b9cf-4529-9f22-6ab55a2fca8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbe962b-85a4-4c4c-88e5-2d7ad58f2334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:57:12 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 1073741824" returned: 0 in 0.548s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:12 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 Nov 05 03:57:12 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbe962b-85a4-4c4c-88e5-2d7ad58f2334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb3d4f91-84f5-498f-8cc5-521c70f10ae7', 'volume_name': 'volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7', 'volume_size': 1, 'image_id': '8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55b120a86ff5f2c573db7fbcdb3fc30c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0d4a63d031748a186390cfa3b11f6e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0113cb92d580a640f385f8ac38f7fa537cf61accc6b94c6dd4fa5112e5a47fd9ecd44be916f2b4ad0c74ad7c8bfcf1ab3660c61c84a62ed4af4b8560c4d80ae5', 'id': '8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'created_at': datetime.datetime(2026, 11, 5, 2, 57, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 57, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921a2c99-8b12-473f-9610-6ef28a1b0545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921a2c99-8b12-473f-9610-6ef28a1b0545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da360d0-e82a-404d-a6ca-55b7a693df7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Volume bb3d4f91-84f5-498f-8cc5-521c70f10ae7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7', 'volume_size': 1, 'image_id': '8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55b120a86ff5f2c573db7fbcdb3fc30c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0d4a63d031748a186390cfa3b11f6e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0113cb92d580a640f385f8ac38f7fa537cf61accc6b94c6dd4fa5112e5a47fd9ecd44be916f2b4ad0c74ad7c8bfcf1ab3660c61c84a62ed4af4b8560c4d80ae5', 'id': '8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'created_at': datetime.datetime(2026, 11, 5, 2, 57, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 57, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 03:57:12 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Trying to clone bb3d4f91-84f5-498f-8cc5-521c70f10ae7 from image 8ca76e64-3e48-4b72-b9c4-1cca5e28898c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:57:13 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Image download 0.00 MB at 0.00 MB/s Nov 05 03:57:13 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120" returned: 0 in 0.353s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b17eed-ba7a-44d6-8429-248b8d6e7824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd88f7f5-138b-4085-9212-6c4802aef120', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d99f389-48ac-4a07-b925-d3f3e3773fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27d3c0a-e47e-4b2d-8506-7d54acfc1069]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:13 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Volume volume-cd88f7f5-138b-4085-9212-6c4802aef120 (cd88f7f5-138b-4085-9212-6c4802aef120): created successfully Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d99f389-48ac-4a07-b925-d3f3e3773fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (6e9a2291-9650-455a-a7d2-022b21fc8a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4dbfd6b8-9b1d-4505-8446-fd7035411bc1 tempest-VolumesGetTest-1041637792 None] Created volume successfully. Nov 05 03:57:13 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD Nov 05 03:57:13 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:13 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:13 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD Nov 05 03:57:13 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:13 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Temporary image 8ca76e64-3e48-4b72-b9c4-1cca5e28898c is fetched for user eaa127bd610f43d081fe68af3cf5da6e. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f48a6c-d3a8-4ae6-bf9b-87e4f50e09ca]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:14 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD Nov 05 03:57:14 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:14 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:14 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD Nov 05 03:57:14 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:14 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD" returned: 1 in 0.475s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3d4f91-84f5-498f-8cc5-521c70f10ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d4a63d031748a186390cfa3b11f6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:12Z,use_quota=True,user_id='eaa127bd610f43d081fe68af3cf5da6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(faa571bb-8f03-4e22-be64-8751b25d01e7),volume_type_id=faa571bb-8f03-4e22-be64-8751b25d01e7)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Creating volume bb3d4f91-84f5-498f-8cc5-521c70f10ae7 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:14 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:14 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 1073741824 Nov 05 03:57:14 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (292286db-d728-4ab1-9b66-b2daa6a4ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce06ef51-d7aa-4187-a869-1fdad5fd0a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce06ef51-d7aa-4187-a869-1fdad5fd0a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-995431958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ba3047-36be-43c6-8e1b-b3dd17750b91,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cd88f7f5-138b-4085-9212-6c4802aef120,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:15Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5695d6e-e9a5-470c-9fea-d2850055de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5695d6e-e9a5-470c-9fea-d2850055de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee726f9-98e1-4bd4-bc5a-71d8a5ec3345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee726f9-98e1-4bd4-bc5a-71d8a5ec3345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b1ba3047-36be-43c6-8e1b-b3dd17750b91', 'volume_name': 'volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91', 'volume_size': 1, 'source_volid': 'cd88f7f5-138b-4085-9212-6c4802aef120', 'source_volstatus': 'available'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bec354-e4fb-4c0a-a15e-7d2d19a6518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bec354-e4fb-4c0a-a15e-7d2d19a6518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e35f09-1394-4059-bdf1-1762c81d3e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:15 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Volume b1ba3047-36be-43c6-8e1b-b3dd17750b91: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91', 'volume_size': 1, 'source_volid': 'cd88f7f5-138b-4085-9212-6c4802aef120', 'source_volstatus': 'available'} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:15 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:15 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:15 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 1073741824" returned: 0 in 0.549s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:15 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 Nov 05 03:57:15 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:15 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.402s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:57:15 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.740s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:15 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Cloning volume cd88f7f5-138b-4085-9212-6c4802aef120 to volume b1ba3047-36be-43c6-8e1b-b3dd17750b91 Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Creating offline snapshot e5ff280a-0123-4b8a-9746-4d53716daebc of volume cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Attempting download of 8ca76e64-3e48-4b72-b9c4-1cca5e28898c ((None, [{'url': 'file:///opt/stack/data/glance/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'metadata': {}}])) to volume bb3d4f91-84f5-498f-8cc5-521c70f10ae7. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[477289b4-1b1a-4d8a-ada0-5f34534787c1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[587f4b26-05ae-4728-8bc7-eaa8c34a3e98]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_vj86v21r {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:16 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 Nov 05 03:57:16 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:16 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_vj86v21r Nov 05 03:57:16 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:16 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_vj86v21r" returned: 0 in 0.359s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_vj86v21r {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:16 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120" returned: 0 in 0.464s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:16 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc 1G Nov 05 03:57:16 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:16 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_vj86v21r Nov 05 03:57:16 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:16 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_vj86v21r" returned: 1 in 0.371s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_vj86v21r' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1734e054-328f-4da1-aabe-a9c1852ecd56]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:16 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD Nov 05 03:57:16 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:16 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc 1G" returned: 0 in 0.585s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd88f7f5-138b-4085-9212-6c4802aef120 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:16 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd88f7f5-138b-4085-9212-6c4802aef120 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc Nov 05 03:57:16 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:17 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:17 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD Nov 05 03:57:17 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:17 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd88f7f5-138b-4085-9212-6c4802aef120 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc" returned: 0 in 0.407s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:17 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc is being set with open permissions: ugo+rw Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:17 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc Nov 05 03:57:17 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:17 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] 8ca76e64-3e48-4b72-b9c4-1cca5e28898c was raw, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:17 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 Nov 05 03:57:17 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:17 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=72,cinder:UPDATE=97,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:57:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:17 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.info Nov 05 03:57:17 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:18 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.info" returned: 0 in 0.337s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:18 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:18 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.info is being set with open permissions: ugo+rw Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7" returned: 0 in 0.603s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ca76e64-3e48-4b72-b9c4-1cca5e28898c_tl37m78tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:57:18 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:18 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.info Nov 05 03:57:18 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:18 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 1G Nov 05 03:57:18 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:18 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.info" returned: 0 in 0.264s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-b1ba3047-36be-43c6-8e1b-b3dd17750b91" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-b1ba3047-36be-43c6-8e1b-b3dd17750b91" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] snapshot: e5ff280a-0123-4b8a-9746-4d53716daebc, volume: b1ba3047-36be-43c6-8e1b-b3dd17750b91, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50606b0-427d-4a50-a430-1e517d0e10b2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:18 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 1G" returned: 0 in 0.444s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Downloaded image 8ca76e64-3e48-4b72-b9c4-1cca5e28898c ((None, [{'url': 'file:///opt/stack/data/glance/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'metadata': {}}])) to volume bb3d4f91-84f5-498f-8cc5-521c70f10ae7 successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Temporary image 8ca76e64-3e48-4b72-b9c4-1cca5e28898c for user eaa127bd610f43d081fe68af3cf5da6e is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Marking volume bb3d4f91-84f5-498f-8cc5-521c70f10ae7 as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Copying metadata from image 8ca76e64-3e48-4b72-b9c4-1cca5e28898c to bb3d4f91-84f5-498f-8cc5-521c70f10ae7. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Creating volume glance metadata for volume bb3d4f91-84f5-498f-8cc5-521c70f10ae7 backed by image 8ca76e64-3e48-4b72-b9c4-1cca5e28898c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '55b120a86ff5f2c573db7fbcdb3fc30c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:57:18 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc Nov 05 03:57:18 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da360d0-e82a-404d-a6ca-55b7a693df7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7', 'volume_size': 1, 'image_id': '8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55b120a86ff5f2c573db7fbcdb3fc30c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0d4a63d031748a186390cfa3b11f6e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0113cb92d580a640f385f8ac38f7fa537cf61accc6b94c6dd4fa5112e5a47fd9ecd44be916f2b4ad0c74ad7c8bfcf1ab3660c61c84a62ed4af4b8560c4d80ae5', 'id': '8ca76e64-3e48-4b72-b9c4-1cca5e28898c', 'created_at': datetime.datetime(2026, 11, 5, 2, 57, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 57, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ca76e64-3e48-4b72-b9c4-1cca5e28898c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1aecca-d785-471d-9445-0612d86c6e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:18 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Volume volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 (bb3d4f91-84f5-498f-8cc5-521c70f10ae7): created successfully Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1aecca-d785-471d-9445-0612d86c6e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Flow 'volume_create_manager' (782c9cd9-852d-453e-8acd-a8200b59b1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-618f0202-1303-467a-9d24-cf267ed2ab58 tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Created volume successfully. Nov 05 03:57:18 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc" returned: 0 in 0.506s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd88f7f5-138b-4085-9212-6c4802aef120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[31219698-79a3-4583-b932-da9ec564cc45]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Acquiring lock "cinder-bb3d4f91-84f5-498f-8cc5-521c70f10ae7-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "cinder-bb3d4f91-84f5-498f-8cc5-521c70f10ae7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:19 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 Nov 05 03:57:19 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Acquiring lock "cinder-quobyte-bb3d4f91-84f5-498f-8cc5-521c70f10ae7" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "cinder-quobyte-bb3d4f91-84f5-498f-8cc5-521c70f10ae7" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c979f43-ec0d-402a-a037-9547c31be019]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:19 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 Nov 05 03:57:19 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:19 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120" returned: 0 in 0.498s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:19 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 Nov 05 03:57:19 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:19 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7" returned: 0 in 0.441s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:19 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7 Nov 05 03:57:19 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:20 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-bb3d4f91-84f5-498f-8cc5-521c70f10ae7" returned: 0 in 0.389s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "cinder-quobyte-bb3d4f91-84f5-498f-8cc5-521c70f10ae7" released by "delete_volume" :: held 0.883s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:20 devstack cinder-volume[87111]: WARNING cinder.quota [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:57:20 devstack cinder-volume[87111]: WARNING cinder.quota [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Created reservations ['74ccdf0b-3edc-4e50-b249-c8f750505f16', '61df9081-fd6c-4a37-8d1c-7ccb2db7264d', 'e9ef2a58-e08b-42ee-909b-855a07aec0c9', 'a438f442-7f2d-48ce-9eaa-e233c3daccb5'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:20 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:20 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:20 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.610s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:20 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Deleted volume successfully. Nov 05 03:57:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e38323f4-3620-4d72-8b4a-8c745bcfeeeb tempest-VolumeAndVolumeTypeFromImageTest-1154679403 None] Lock "cinder-bb3d4f91-84f5-498f-8cc5-521c70f10ae7-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:27 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91" returned: 0 in 7.769s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120, size 1024.00 MB, duration 7.77 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:57:27 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Converted 1024.00 MB image at 131.80 MB/s Nov 05 03:57:27 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 is being set with open permissions: ugo+rw Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:27 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 Nov 05 03:57:27 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:27 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91" returned: 0 in 0.251s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-b1ba3047-36be-43c6-8e1b-b3dd17750b91" released by "_copy_volume_from_snapshot" :: held 9.122s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-e5ff280a-0123-4b8a-9746-4d53716daebc" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-e5ff280a-0123-4b8a-9746-4d53716daebc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Deleting offline snapshot e5ff280a-0123-4b8a-9746-4d53716daebc of volume cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] snapshot_file for this snap is: volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ebbcb-7dd1-48fd-957f-e651660997fb]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:27 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc Nov 05 03:57:27 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:28 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc" returned: 0 in 0.374s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd88f7f5-138b-4085-9212-6c4802aef120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b63b89-0ee5-4d42-b01f-c0f79ea73c35]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:28 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 Nov 05 03:57:28 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (51e073c1-d6b9-40cd-9435-b36d981080ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7477831-2f64-44c2-b5ba-aea69e228121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7477831-2f64-44c2-b5ba-aea69e228121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139628746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef273d5-5630-488c-9ff9-6e4e54a6d8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:29Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca9e615-6f5a-435e-860a-7e4c028f4d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca9e615-6f5a-435e-860a-7e4c028f4d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df7a0ff-777d-421f-bca8-042d1c569c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df7a0ff-777d-421f-bca8-042d1c569c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef273d5-5630-488c-9ff9-6e4e54a6d8c2', 'volume_name': 'volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88e45a1-0e3f-48c8-93c9-2b5b9f2e372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88e45a1-0e3f-48c8-93c9-2b5b9f2e372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88f7323-9d79-4ad7-a041-35668b8b8cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:28 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Volume 6ef273d5-5630-488c-9ff9-6e4e54a6d8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2', 'volume_size': 1} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:28 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120" returned: 0 in 0.595s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:28 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc Nov 05 03:57:28 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:28 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (b04ed9ca-4b7b-40f0-b0f4-6a5716c88aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8937fcb0-577a-4b4e-825a-42604999a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8937fcb0-577a-4b4e-825a-42604999a325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2118252755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dd0eff-4d19-4531-896a-958df92b3a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:29Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597068de-6401-4236-a857-05607a42a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597068de-6401-4236-a857-05607a42a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a68e4d-0ceb-449e-83f4-4710457769ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a68e4d-0ceb-449e-83f4-4710457769ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28dd0eff-4d19-4531-896a-958df92b3a03', 'volume_name': 'volume-28dd0eff-4d19-4531-896a-958df92b3a03', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76196825-ef66-45f4-b5fa-8df197458869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76196825-ef66-45f4-b5fa-8df197458869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ece331-494d-4cb9-a9a8-4f8b17e6b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Volume 28dd0eff-4d19-4531-896a-958df92b3a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28dd0eff-4d19-4531-896a-958df92b3a03', 'volume_size': 1} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:29 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc" returned: 0 in 0.404s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:29 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc Nov 05 03:57:29 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:29 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (95d283f5-bba0-4360-a8fc-b6a26a20605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26b8d12-2de8-4f2b-be04-3b28369910f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120.e5ff280a-0123-4b8a-9746-4d53716daebc" returned: 0 in 0.338s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26b8d12-2de8-4f2b-be04-3b28369910f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-830662366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7562d9f-c366-4e55-acfc-cca1dd7c494b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:29Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626013d9-d437-4dc0-a7e5-9f2f09347ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626013d9-d437-4dc0-a7e5-9f2f09347ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715c23e4-ac4c-44f7-ad30-19f9d822c105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715c23e4-ac4c-44f7-ad30-19f9d822c105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7562d9f-c366-4e55-acfc-cca1dd7c494b', 'volume_name': 'volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c65fcc8-f137-4800-9aab-70b5393ef6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c65fcc8-f137-4800-9aab-70b5393ef6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba660aff-6cd1-42e8-a89b-90171d128700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Volume b7562d9f-c366-4e55-acfc-cca1dd7c494b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b', 'volume_size': 1} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-e5ff280a-0123-4b8a-9746-4d53716daebc" released by "_delete_snapshot" :: held 1.867s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.781s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.886s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139628746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef273d5-5630-488c-9ff9-6e4e54a6d8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:29Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Creating volume 6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:29 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e35f09-1394-4059-bdf1-1762c81d3e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91', 'volume_size': 1, 'source_volid': 'cd88f7f5-138b-4085-9212-6c4802aef120', 'source_volstatus': 'available'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 1073741824 Nov 05 03:57:29 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6eeef00-42f9-430c-b6cc-aac26b827b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Volume volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 (b1ba3047-36be-43c6-8e1b-b3dd17750b91): created successfully Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6eeef00-42f9-430c-b6cc-aac26b827b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (292286db-d728-4ab1-9b66-b2daa6a4ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9fb92cb6-d558-4939-821a-2ef07da6b332 tempest-VolumesGetTest-1041637792 None] Created volume successfully. Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (8033162c-95f4-4dd4-9bf3-89d9dc6f03f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc454040-2234-4e28-8f1a-7d717f701651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc454040-2234-4e28-8f1a-7d717f701651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1737760081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589a9734-cf2f-44ec-a53b-bd486fa36197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:30Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3168121-2127-430c-bba5-c49638f15c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3168121-2127-430c-bba5-c49638f15c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2ace85-a253-4765-a26d-99d28cea4823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2ace85-a253-4765-a26d-99d28cea4823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589a9734-cf2f-44ec-a53b-bd486fa36197', 'volume_name': 'volume-589a9734-cf2f-44ec-a53b-bd486fa36197', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de447fa-a5f5-43cd-a490-31ef6bd8c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de447fa-a5f5-43cd-a490-31ef6bd8c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ab2de9-dd14-4a1a-b8c1-d6a326b053b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Volume 589a9734-cf2f-44ec-a53b-bd486fa36197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589a9734-cf2f-44ec-a53b-bd486fa36197', 'volume_size': 1} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:30 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 1073741824" returned: 0 in 0.569s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:30 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 Nov 05 03:57:30 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (8b82a370-d8b6-4ae3-b410-6ecc8250b621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20503aa-33ba-4e0a-a7fb-eef3b9abd460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20503aa-33ba-4e0a-a7fb-eef3b9abd460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1224525442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d5bfc9-6a16-4368-97c8-9beaf961090a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:30Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0e34a4-d500-4625-8e76-ffb277e474d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0e34a4-d500-4625-8e76-ffb277e474d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb46952-3841-445b-8244-4008cde64201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb46952-3841-445b-8244-4008cde64201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d5bfc9-6a16-4368-97c8-9beaf961090a', 'volume_name': 'volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b79be6-c4cc-4b14-8ac3-324ff233d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b79be6-c4cc-4b14-8ac3-324ff233d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2136e834-e79f-4240-bda1-d0fc02b6ed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Volume c7d5bfc9-6a16-4368-97c8-9beaf961090a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a', 'volume_size': 1} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:30 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2118252755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dd0eff-4d19-4531-896a-958df92b3a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:29Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Creating volume 28dd0eff-4d19-4531-896a-958df92b3a03 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:30 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88f7323-9d79-4ad7-a041-35668b8b8cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0e7ea6-3909-42fc-9961-170f1b11deb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:30 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 1073741824 Nov 05 03:57:30 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:30 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Volume volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 (6ef273d5-5630-488c-9ff9-6e4e54a6d8c2): created successfully Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0e7ea6-3909-42fc-9961-170f1b11deb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (51e073c1-d6b9-40cd-9435-b36d981080ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-17b2445a-d2a2-4d3d-924c-7ec6078057e2 tempest-CreateVolumesFromImageTest-1295819217 None] Created volume successfully. Nov 05 03:57:30 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 1073741824" returned: 0 in 0.523s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (f35ae827-2875-4e8e-bff4-821eaf0d409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77ddcac-d2ea-4c27-ac10-ef746b6dec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77ddcac-d2ea-4c27-ac10-ef746b6dec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-946069598',display_name='tempest-VolumesGetTest-Volume-1744575428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:31Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:31 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 Nov 05 03:57:31 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16726b0e-22c2-4904-aa2f-15cc08f1b73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16726b0e-22c2-4904-aa2f-15cc08f1b73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa545a7e-338f-49dc-a573-37f75907f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa545a7e-338f-49dc-a573-37f75907f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe', 'volume_name': 'volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a998a368-bdd0-465d-831c-cdc793c4c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a998a368-bdd0-465d-831c-cdc793c4c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b957e3d-5b12-43dc-b972-e045bf3b5820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:31 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Volume da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe', 'volume_size': 1} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:31 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03" returned: 0 in 0.268s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-830662366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7562d9f-c366-4e55-acfc-cca1dd7c494b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:29Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Creating volume b7562d9f-c366-4e55-acfc-cca1dd7c494b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:31 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ece331-494d-4cb9-a9a8-4f8b17e6b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28dd0eff-4d19-4531-896a-958df92b3a03', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:31 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b 1073741824 Nov 05 03:57:31 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c39a4d-8912-49e8-a73f-a9f546deff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:31 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Volume volume-28dd0eff-4d19-4531-896a-958df92b3a03 (28dd0eff-4d19-4531-896a-958df92b3a03): created successfully Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c39a4d-8912-49e8-a73f-a9f546deff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (b04ed9ca-4b7b-40f0-b0f4-6a5716c88aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-38913e37-682b-4100-97d9-c7b7c4ffa90c tempest-CreateVolumesFromImageTest-1295819217 None] Created volume successfully. Nov 05 03:57:31 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b 1073741824" returned: 0 in 0.426s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:31 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b Nov 05 03:57:31 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:32 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b" returned: 0 in 0.256s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.023s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1737760081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589a9734-cf2f-44ec-a53b-bd486fa36197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:30Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Creating volume 589a9734-cf2f-44ec-a53b-bd486fa36197 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:32 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba660aff-6cd1-42e8-a89b-90171d128700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:32 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 1073741824 Nov 05 03:57:32 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10638927-1140-4a6a-ba69-00efc8155b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:32 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Volume volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b (b7562d9f-c366-4e55-acfc-cca1dd7c494b): created successfully Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10638927-1140-4a6a-ba69-00efc8155b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (95d283f5-bba0-4360-a8fc-b6a26a20605d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-433c88b2-608e-4a9b-8390-4cbababd1dfd tempest-CreateVolumesFromImageTest-1295819217 None] Created volume successfully. Nov 05 03:57:32 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 1073741824" returned: 0 in 0.469s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:32 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 Nov 05 03:57:32 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:32 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197" returned: 0 in 0.242s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.496s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1224525442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d5bfc9-6a16-4368-97c8-9beaf961090a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ab8fbf00ef4b35bf64c30b0a57aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:30Z,use_quota=True,user_id='f756403f827a49d6a5c1ec8fc2183503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Creating volume c7d5bfc9-6a16-4368-97c8-9beaf961090a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:32 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ab2de9-dd14-4a1a-b8c1-d6a326b053b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589a9734-cf2f-44ec-a53b-bd486fa36197', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:32 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a 1073741824 Nov 05 03:57:32 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a3cdb5-84b1-4525-8079-6b2e74e5062a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:32 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Volume volume-589a9734-cf2f-44ec-a53b-bd486fa36197 (589a9734-cf2f-44ec-a53b-bd486fa36197): created successfully Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a3cdb5-84b1-4525-8079-6b2e74e5062a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:32 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (8033162c-95f4-4dd4-9bf3-89d9dc6f03f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-34a6d064-e5b4-4a56-bcb2-0839faed36c8 tempest-CreateVolumesFromImageTest-1295819217 None] Created volume successfully. Nov 05 03:57:33 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a 1073741824" returned: 0 in 0.421s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:33 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a Nov 05 03:57:33 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:33 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.460s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-946069598',display_name='tempest-VolumesGetTest-Volume-1744575428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:31Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Creating volume da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:33 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:33 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe 1073741824 Nov 05 03:57:33 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2136e834-e79f-4240-bda1-d0fc02b6ed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bb497a-5983-4d5f-a153-8bc4a9ed5a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:33 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Volume volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a (c7d5bfc9-6a16-4368-97c8-9beaf961090a): created successfully Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bb497a-5983-4d5f-a153-8bc4a9ed5a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:33 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Flow 'volume_create_manager' (8b82a370-d8b6-4ae3-b410-6ecc8250b621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:33 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-bcaf6938-3df9-4097-a052-8bd74e850d1b tempest-CreateVolumesFromImageTest-1295819217 None] Created volume successfully. Nov 05 03:57:33 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe 1073741824" returned: 0 in 0.408s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:34 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe Nov 05 03:57:34 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:34 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe" returned: 0 in 0.239s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b957e3d-5b12-43dc-b972-e045bf3b5820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1778978a-4402-42d7-a8ef-8b8bb3a93d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:34 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Volume volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe (da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe): created successfully Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1778978a-4402-42d7-a8ef-8b8bb3a93d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (f35ae827-2875-4e8e-bff4-821eaf0d409c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:34 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cf5cbcba-b025-4e1e-a6d9-6578531f2052 tempest-VolumesGetTest-1041637792 None] Created volume successfully. Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-c7d5bfc9-6a16-4368-97c8-9beaf961090a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-c7d5bfc9-6a16-4368-97c8-9beaf961090a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-quobyte-c7d5bfc9-6a16-4368-97c8-9beaf961090a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-c7d5bfc9-6a16-4368-97c8-9beaf961090a" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603f556-519a-476f-8d61-f5af5b1900b0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:34 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a Nov 05 03:57:34 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:35 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a" returned: 0 in 0.386s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:35 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a Nov 05 03:57:35 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Lock "cinder-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe" acquired by "delete_volume" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:35 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7d5bfc9-6a16-4368-97c8-9beaf961090a" returned: 0 in 0.282s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd870e7-61e1-4af9-b57c-24aafeb4feff]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-c7d5bfc9-6a16-4368-97c8-9beaf961090a" released by "delete_volume" :: held 0.720s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Created reservations ['38e476fb-3062-450f-9d90-4d80a0170e3b', '77be374e-8d59-42a1-93bb-68db890ce215', '340604f2-3a1b-49cb-a1b2-f8a71c3c5bdd', 'c7a8d82e-5d2c-44fc-b9ec-39b714d63178'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:35 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe Nov 05 03:57:35 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:35 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:35 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-589a9734-cf2f-44ec-a53b-bd486fa36197-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:35 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe" returned: 0 in 0.386s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-589a9734-cf2f-44ec-a53b-bd486fa36197-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:35 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe Nov 05 03:57:35 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:35 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.292s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:35 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Deleted volume successfully. Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-421bfe74-cba9-4b8c-a81e-e40f3875ba21 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-c7d5bfc9-6a16-4368-97c8-9beaf961090a-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-quobyte-589a9734-cf2f-44ec-a53b-bd486fa36197" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-589a9734-cf2f-44ec-a53b-bd486fa36197" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5201d8-65f6-44db-a806-c0f4d24a484c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:36 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 Nov 05 03:57:36 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:36 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe" returned: 0 in 0.306s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe" released by "delete_volume" :: held 0.741s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Created reservations ['472d15f4-50f9-4377-8ac3-7ebfb759d957', '529c46dd-0a3b-4030-9b6c-46fdc7adc62b', '6f454622-345a-46d6-84a2-ed50c83e5597', '61e20fb1-2093-415e-8d1c-d94452a3d3d1'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:36 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:36 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:36 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197" returned: 0 in 0.389s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:36 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197 Nov 05 03:57:36 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-b1ba3047-36be-43c6-8e1b-b3dd17750b91-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:36 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Lock "cinder-b1ba3047-36be-43c6-8e1b-b3dd17750b91-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.310s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:36 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Deleted volume successfully. Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f18dbc1b-7f25-4535-99ba-04088c4b5515 tempest-VolumesGetTest-1041637792 None] Lock "cinder-da0ce73f-7eb9-4dcc-b79e-1788d6cc48fe-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-b1ba3047-36be-43c6-8e1b-b3dd17750b91" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-b1ba3047-36be-43c6-8e1b-b3dd17750b91" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:36 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-589a9734-cf2f-44ec-a53b-bd486fa36197" returned: 0 in 0.324s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-589a9734-cf2f-44ec-a53b-bd486fa36197" released by "delete_volume" :: held 0.761s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab55a5ab-f4ac-4096-96a6-5e323be98bf0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Created reservations ['8d19ff54-8698-4591-9689-1e640d44788d', 'a4b6076c-fe22-4bfb-9a38-a3af3cb817a5', 'fe7f0d8a-b515-4f55-9b6c-7b221090863f', '08f7ee89-d70c-418c-b7f1-d59ddfa72b48'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:36 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:36 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:36 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:36 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-b7562d9f-c366-4e55-acfc-cca1dd7c494b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-b7562d9f-c366-4e55-acfc-cca1dd7c494b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-quobyte-b7562d9f-c366-4e55-acfc-cca1dd7c494b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-b7562d9f-c366-4e55-acfc-cca1dd7c494b" acquired by "delete_volume" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[496e6d77-8efb-409d-ae95-cfa86e24723f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:37 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Deleted volume successfully. Nov 05 03:57:37 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91" returned: 0 in 0.456s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-237c0cb9-baf4-49b9-88b1-6894f0ba101c tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-589a9734-cf2f-44ec-a53b-bd486fa36197-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:37 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91 Nov 05 03:57:37 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:37 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b Nov 05 03:57:37 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:37 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b1ba3047-36be-43c6-8e1b-b3dd17750b91" returned: 0 in 0.254s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-b1ba3047-36be-43c6-8e1b-b3dd17750b91" released by "delete_volume" :: held 0.755s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Created reservations ['d496f32e-9c47-4d35-b116-1a6b7442420d', '320b4fdd-78ca-45de-b7eb-dbd4e1ff2cb7', '92344a26-075f-4335-a21d-ae493ba5abd3', '90698e4f-778a-4a03-a525-97e70dd3417e'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:37 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b" returned: 0 in 0.420s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:37 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b Nov 05 03:57:37 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:37 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:37 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-cd88f7f5-138b-4085-9212-6c4802aef120-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Lock "cinder-cd88f7f5-138b-4085-9212-6c4802aef120-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:37 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b7562d9f-c366-4e55-acfc-cca1dd7c494b" returned: 0 in 0.318s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-b7562d9f-c366-4e55-acfc-cca1dd7c494b" released by "delete_volume" :: held 0.792s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:37 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.295s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:37 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Deleted volume successfully. Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-980433f3-45bd-4fde-9d0a-01a20b71edf6 tempest-VolumesGetTest-1041637792 None] Lock "cinder-b1ba3047-36be-43c6-8e1b-b3dd17750b91-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-cd88f7f5-138b-4085-9212-6c4802aef120" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-cd88f7f5-138b-4085-9212-6c4802aef120" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Created reservations ['9f6fe016-b10e-4d2d-b981-63a658c0a94e', 'd9478398-e3c6-43c6-aad9-c87b48e96047', 'aea3aa77-42b4-4432-a253-b0f6a345d7db', '34ee045b-6fb2-4bc3-b8de-1445d987f93a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3dd36e-aa92-4452-95c8-a3054bb0b659]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:38 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:38 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:38 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 Nov 05 03:57:38 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-28dd0eff-4d19-4531-896a-958df92b3a03-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-28dd0eff-4d19-4531-896a-958df92b3a03-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-quobyte-28dd0eff-4d19-4531-896a-958df92b3a03" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-28dd0eff-4d19-4531-896a-958df92b3a03" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c70fb-a658-4864-803a-d007145c6990]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:38 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.302s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:38 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Deleted volume successfully. Nov 05 03:57:38 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 Nov 05 03:57:38 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d966d5b9-f54f-4e2b-9ebe-a812493ba703 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-b7562d9f-c366-4e55-acfc-cca1dd7c494b-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:38 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120" returned: 0 in 0.438s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:38 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120 Nov 05 03:57:38 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:38 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03" returned: 0 in 0.393s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:38 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-cd88f7f5-138b-4085-9212-6c4802aef120" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:38 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03 Nov 05 03:57:38 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-cd88f7f5-138b-4085-9212-6c4802aef120" released by "delete_volume" :: held 0.770s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Created reservations ['7c957e95-853d-4466-888d-c7a963f36ee3', 'b48e9eed-589a-4444-844f-853026f3ad0d', '10c86939-6a19-475f-a53b-dfd0a67b2aba', '9e35a030-27e7-43c6-b33e-b19c33e377f2'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:38 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:38 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:39 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-28dd0eff-4d19-4531-896a-958df92b3a03" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-28dd0eff-4d19-4531-896a-958df92b3a03" released by "delete_volume" :: held 0.748s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Created reservations ['de6430d9-4fbb-4a1f-ad28-6effbceefe45', '3f64a223-906e-4ffd-9c2a-f8eb902b2d75', 'bdb7d10e-efe1-41b1-b04c-40243f41eb8b', '767e8dd9-acd1-40fb-b2c1-c1c34eec3f08'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:39 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.269s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Deleted volume successfully. Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cc592a8f-2da1-4c51-85be-6edcdfefc030 tempest-VolumesGetTest-1041637792 None] Lock "cinder-cd88f7f5-138b-4085-9212-6c4802aef120-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:39 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:39 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "cinder-quobyte-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:39 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84239f4-2cdc-466c-863b-69eb67d8d946]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:39 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Deleted volume successfully. Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-03cbe390-7d27-472a-9646-b9868c5cb705 tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-28dd0eff-4d19-4531-896a-958df92b3a03-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:39 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 Nov 05 03:57:39 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (6cc77dc0-5405-4705-9ffc-2d89896a6b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c645ae8c-f52c-40e3-ab97-146143df5fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c645ae8c-f52c-40e3-ab97-146143df5fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1882276175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bc734f-ad86-46dc-be61-a5d10eb7ac76,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:40Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3a8d27-15c9-4a95-aeff-f9118567e5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3a8d27-15c9-4a95-aeff-f9118567e5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb7306a-b392-4abc-b169-9df82b99c2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:57:39 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2" returned: 0 in 0.398s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:40 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2 Nov 05 03:57:40 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:40 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2" returned: 0 in 0.263s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-quobyte-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2" released by "delete_volume" :: held 0.732s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb7306a-b392-4abc-b169-9df82b99c2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1bc734f-ad86-46dc-be61-a5d10eb7ac76', 'volume_name': 'volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1386f426-778c-4949-8bfc-9003fab8f431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1386f426-778c-4949-8bfc-9003fab8f431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52088bf4-aa89-43ff-b2e5-1b3ef1df6e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:40 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Volume a1bc734f-ad86-46dc-be61-a5d10eb7ac76: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Trying to clone a1bc734f-ad86-46dc-be61-a5d10eb7ac76 from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Created reservations ['104a66fc-521f-41e8-a352-161c796f1741', 'd9319e25-4e44-4a6a-b61c-903154768ca9', '0c9571a0-e9d1-445c-9dcb-3c52325ec785', '50c44232-5906-4e5c-96c0-28260429d25a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:40 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:40 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:57:40 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd21b3a3-d982-4c92-81bc-41e0578d379a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:40 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.334s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:40 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Deleted volume successfully. Nov 05 03:57:40 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD Nov 05 03:57:40 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cf5bb95f-a105-4a03-a439-47279706287f tempest-CreateVolumesFromImageTest-1295819217 None] Lock "cinder-6ef273d5-5630-488c-9ff9-6e4e54a6d8c2-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:41 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 is fetched for user 9003d56323664709bd14b5235a33a6f3. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927126b-526e-4884-8adc-267798d834f9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:41 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD Nov 05 03:57:41 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:41 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1882276175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bc734f-ad86-46dc-be61-a5d10eb7ac76,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:40Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Creating volume a1bc734f-ad86-46dc-be61-a5d10eb7ac76 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:41 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:41 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 1073741824 Nov 05 03:57:41 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:42 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 1073741824" returned: 0 in 0.497s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:42 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 Nov 05 03:57:42 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:42 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76" returned: 0 in 0.258s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Attempting download of f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume a1bc734f-ad86-46dc-be61-a5d10eb7ac76. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a6edc7-b0ac-4b63-a14c-ebaeeacfdf4c]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_llupjcs2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:42 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_llupjcs2 Nov 05 03:57:42 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:42 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_llupjcs2" returned: 0 in 0.338s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_llupjcs2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:42 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_llupjcs2 Nov 05 03:57:42 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:43 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_llupjcs2" returned: 1 in 0.332s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_llupjcs2' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c4da7-ebcd-4e21-bf01-9f205c3ba29c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:43 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD Nov 05 03:57:43 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:43 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] f813bdfc-9ad7-4949-b238-678b8d2b8f65 was qcow2, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:43 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 Nov 05 03:57:43 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (0010aec1-8beb-4414-94d0-f6536b79ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dda19ed-1832-46cd-bdd2-269ae159b391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dda19ed-1832-46cd-bdd2-269ae159b391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102704725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:44Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a951f12-b031-4cf4-b8d8-ed5b7f2d0588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a951f12-b031-4cf4-b8d8-ed5b7f2d0588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9352a980-0ecb-4595-837e-104d4a792f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9352a980-0ecb-4595-837e-104d4a792f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0', 'volume_name': 'volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa4f255-7ac5-47d1-9bbb-b56218c19502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa4f255-7ac5-47d1-9bbb-b56218c19502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00ef241-51eb-43e6-9eaf-351f7ab95391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:43 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume 74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0', 'volume_size': 1} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102704725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:44Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Creating volume 74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:43 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:43 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 1073741824 Nov 05 03:57:43 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:44 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 1073741824" returned: 0 in 0.487s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:44 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 Nov 05 03:57:44 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:44 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0" returned: 0 in 0.287s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00ef241-51eb-43e6-9eaf-351f7ab95391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7626fc3b-9e54-4a18-a8a9-32f01e76b0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:44 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 (74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0): created successfully Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7626fc3b-9e54-4a18-a8a9-32f01e76b0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (0010aec1-8beb-4414-94d0-f6536b79ded3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:44 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a582a786-3d04-40c0-91f5-c5c9dfba2fb6 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created volume successfully. Nov 05 03:57:45 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76" returned: 0 in 1.898s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_87jd18eddevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:57:45 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Converted 112.00 MB image at 58.97 MB/s Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:45 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 1G Nov 05 03:57:45 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:45 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 1G" returned: 0 in 0.348s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Downloaded image f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume a1bc734f-ad86-46dc-be61-a5d10eb7ac76 successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 for user 9003d56323664709bd14b5235a33a6f3 is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Marking volume a1bc734f-ad86-46dc-be61-a5d10eb7ac76 as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=155,cinder:UPDATE=165,cinder:INSERT=46,cinder:DELETE=13 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Copying metadata from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 to a1bc734f-ad86-46dc-be61-a5d10eb7ac76. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Creating volume glance metadata for volume a1bc734f-ad86-46dc-be61-a5d10eb7ac76 backed by image f813bdfc-9ad7-4949-b238-678b8d2b8f65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52088bf4-aa89-43ff-b2e5-1b3ef1df6e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf0ad32-dbf8-41d7-a60b-032e35989ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:45 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Volume volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 (a1bc734f-ad86-46dc-be61-a5d10eb7ac76): created successfully Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf0ad32-dbf8-41d7-a60b-032e35989ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (6cc77dc0-5405-4705-9ffc-2d89896a6b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:45 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c2366322-e187-4795-b5d6-f5b5c8de946c tempest-VolumesGetTest-1041637792 None] Created volume successfully. Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (05734bc2-a8b5-4d10-89b2-601c03405bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd890c55-5531-432f-9370-e21d6a1ab8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd890c55-5531-432f-9370-e21d6a1ab8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547328540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9467656-5fe9-4496-ad12-bf9d8ae52eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:46Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89e69f5-c1d1-4f6b-b8fb-5116a5c61f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89e69f5-c1d1-4f6b-b8fb-5116a5c61f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3e04ae-f7f7-47df-8522-09e2115a9942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3e04ae-f7f7-47df-8522-09e2115a9942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9467656-5fe9-4496-ad12-bf9d8ae52eda', 'volume_name': 'volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e221ee59-f12f-476d-99f3-938864d8284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e221ee59-f12f-476d-99f3-938864d8284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d571ad5c-1ad3-4fe6-95d9-be2db1947829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume b9467656-5fe9-4496-ad12-bf9d8ae52eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda', 'volume_size': 1} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547328540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9467656-5fe9-4496-ad12-bf9d8ae52eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:46Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Creating volume b9467656-5fe9-4496-ad12-bf9d8ae52eda {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:46 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:46 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda 1073741824 Nov 05 03:57:46 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (2514851a-af7e-4860-8f5b-970f4f034a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce53e33-88ed-4534-913e-50cfc1b5628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce53e33-88ed-4534-913e-50cfc1b5628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-503696705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:47Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff77d9ae-e746-42bf-b750-c7e85ad8154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff77d9ae-e746-42bf-b750-c7e85ad8154f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c686cf-b680-4ba2-a154-31b4ea203de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c686cf-b680-4ba2-a154-31b4ea203de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014', 'volume_name': 'volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3387831-1d99-476c-b496-de611dabe1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3387831-1d99-476c-b496-de611dabe1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492803e4-6c4f-45eb-9f28-d1a2fcf6068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:46 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume 1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014', 'volume_size': 1} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:46 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda 1073741824" returned: 0 in 0.583s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:46 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda Nov 05 03:57:46 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:47 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-503696705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:47Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Creating volume 1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:47 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d571ad5c-1ad3-4fe6-95d9-be2db1947829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fdd513-0d18-4649-9109-1d39ef7ffd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 1073741824 Nov 05 03:57:47 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (fcab9642-3831-4c68-b7d0-676065a9ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a88952-9618-42ec-8e54-261c9b601166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda (b9467656-5fe9-4496-ad12-bf9d8ae52eda): created successfully Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fdd513-0d18-4649-9109-1d39ef7ffd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (05734bc2-a8b5-4d10-89b2-601c03405bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a88952-9618-42ec-8e54-261c9b601166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1750303946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9843437d-d943-448b-ba8a-625bbd6ac760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:47Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc36cce-f05d-4285-bb72-f87ea1837028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc36cce-f05d-4285-bb72-f87ea1837028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7056eb8-b04e-4271-aa6f-61ea88c26a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7056eb8-b04e-4271-aa6f-61ea88c26a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9843437d-d943-448b-ba8a-625bbd6ac760', 'volume_name': 'volume-9843437d-d943-448b-ba8a-625bbd6ac760', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9120e1e-6cbf-4d29-8e73-27790edc2dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9120e1e-6cbf-4d29-8e73-27790edc2dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d5501a-6b04-4713-ae60-b7425225c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume 9843437d-d943-448b-ba8a-625bbd6ac760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9843437d-d943-448b-ba8a-625bbd6ac760', 'volume_size': 1} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:47 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-bbcc61ff-f283-43af-ac44-aa54079c0591 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created volume successfully. Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (cd99c892-8cb1-4f56-a507-03747ff6bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f837d986-a897-4396-84e5-098ceabbc467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f837d986-a897-4396-84e5-098ceabbc467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-902445742',display_name='tempest-VolumesGetTest-Volume-666727014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c31a6b9-e190-4fb4-860c-7940017a635f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:47Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d04af7-958d-450a-83fb-c225839d3b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d04af7-958d-450a-83fb-c225839d3b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1263f3-41f3-4d74-bb4b-b003e0a21d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1263f3-41f3-4d74-bb4b-b003e0a21d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c31a6b9-e190-4fb4-860c-7940017a635f', 'volume_name': 'volume-3c31a6b9-e190-4fb4-860c-7940017a635f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee18f947-3b92-4208-924a-f03830021131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee18f947-3b92-4208-924a-f03830021131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fc4185-3233-4b13-afd1-8c313cc2a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Volume 3c31a6b9-e190-4fb4-860c-7940017a635f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c31a6b9-e190-4fb4-860c-7940017a635f', 'volume_size': 1} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (2a048fb9-f20d-423d-a072-3a6b71fb49a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bd06d2-5402-4212-a41e-75ecdbbbb639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bd06d2-5402-4212-a41e-75ecdbbbb639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-325620906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0244cf83-c345-4fdb-83a3-c0782e1f7beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:48Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50c109f-777d-4caa-bc02-bc31879df72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50c109f-777d-4caa-bc02-bc31879df72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c64461-44a7-41a2-beee-91e10fc4b8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c64461-44a7-41a2-beee-91e10fc4b8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0244cf83-c345-4fdb-83a3-c0782e1f7beb', 'volume_name': 'volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a173aa-0cd2-48d9-9e02-6d130ae7e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a173aa-0cd2-48d9-9e02-6d130ae7e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5c0370-3127-40a7-bd2b-4b0cda1e4b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:47 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume 0244cf83-c345-4fdb-83a3-c0782e1f7beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb', 'volume_size': 1} Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:47 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 1073741824" returned: 0 in 0.706s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (e34d62ec-d0c3-4dd2-8e28-bb070bbb2554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f092884-ff99-4c5f-8f74-8de8b4ca3ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f092884-ff99-4c5f-8f74-8de8b4ca3ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1103978065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe59d3d-d22c-4107-9d44-3dd2265f3f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:48Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0feb2f03-e117-46dd-accc-177dd6be1c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:48 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 Nov 05 03:57:48 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0feb2f03-e117-46dd-accc-177dd6be1c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00445c7-b83e-46e4-85ae-3a3bf97c159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00445c7-b83e-46e4-85ae-3a3bf97c159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe59d3d-d22c-4107-9d44-3dd2265f3f11', 'volume_name': 'volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b547ab-9829-43d6-b919-b2015872ee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b547ab-9829-43d6-b919-b2015872ee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041b90a7-8151-4809-8a43-029f4887efc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:48 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume 7fe59d3d-d22c-4107-9d44-3dd2265f3f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11', 'volume_size': 1} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:48 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014" returned: 0 in 0.277s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1750303946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9843437d-d943-448b-ba8a-625bbd6ac760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:47Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Creating volume 9843437d-d943-448b-ba8a-625bbd6ac760 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:48 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492803e4-6c4f-45eb-9f28-d1a2fcf6068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a212b2b4-0d45-43b6-8b4c-00a3b7100d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:48 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 1073741824 Nov 05 03:57:48 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:48 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 (1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014): created successfully Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a212b2b4-0d45-43b6-8b4c-00a3b7100d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (2514851a-af7e-4860-8f5b-970f4f034a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cb5cc599-0cee-413f-9670-5d86fc80aa46 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created volume successfully. Nov 05 03:57:48 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 1073741824" returned: 0 in 0.435s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:48 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 Nov 05 03:57:48 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:49 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760" returned: 0 in 0.292s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-902445742',display_name='tempest-VolumesGetTest-Volume-666727014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c31a6b9-e190-4fb4-860c-7940017a635f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b08aa8d7e6c455b908c611cdc6a812e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:47Z,use_quota=True,user_id='9003d56323664709bd14b5235a33a6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Creating volume 3c31a6b9-e190-4fb4-860c-7940017a635f {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:49 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d5501a-6b04-4713-ae60-b7425225c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9843437d-d943-448b-ba8a-625bbd6ac760', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:49 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f 1073741824 Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe9901b-7fd9-4818-b4db-71a9893db088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:49 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:49 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume volume-9843437d-d943-448b-ba8a-625bbd6ac760 (9843437d-d943-448b-ba8a-625bbd6ac760): created successfully Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe9901b-7fd9-4818-b4db-71a9893db088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (fcab9642-3831-4c68-b7d0-676065a9ede8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-060774dc-02cc-45dd-968d-dcd3de7ce09d tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created volume successfully. Nov 05 03:57:49 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f 1073741824" returned: 0 in 0.414s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:49 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f Nov 05 03:57:49 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:49 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f" returned: 0 in 0.253s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.068s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-325620906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0244cf83-c345-4fdb-83a3-c0782e1f7beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:48Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Creating volume 0244cf83-c345-4fdb-83a3-c0782e1f7beb {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:49 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fc4185-3233-4b13-afd1-8c313cc2a226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c31a6b9-e190-4fb4-860c-7940017a635f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:49 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb 1073741824 Nov 05 03:57:49 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c25e550-c522-4192-bc62-d650efd908fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:49 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Volume volume-3c31a6b9-e190-4fb4-860c-7940017a635f (3c31a6b9-e190-4fb4-860c-7940017a635f): created successfully Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c25e550-c522-4192-bc62-d650efd908fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Flow 'volume_create_manager' (cd99c892-8cb1-4f56-a507-03747ff6bba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-949cf1a2-fa4d-4cc7-8627-422f0935bdf5 tempest-VolumesGetTest-1041637792 None] Created volume successfully. Nov 05 03:57:50 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb 1073741824" returned: 0 in 0.476s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:50 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb Nov 05 03:57:50 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-3c31a6b9-e190-4fb4-860c-7940017a635f-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Lock "cinder-3c31a6b9-e190-4fb4-860c-7940017a635f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-3c31a6b9-e190-4fb4-860c-7940017a635f" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-3c31a6b9-e190-4fb4-860c-7940017a635f" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab0289b-7928-49ef-85a9-f2ce2859c7cf]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:50 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb" returned: 0 in 0.289s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.680s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1103978065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe59d3d-d22c-4107-9d44-3dd2265f3f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0462b461b760454fa570a607051d65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:48Z,use_quota=True,user_id='1fca6aca8ec14c20b45688081b63d1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Creating volume 7fe59d3d-d22c-4107-9d44-3dd2265f3f11 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:50 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5c0370-3127-40a7-bd2b-4b0cda1e4b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:50 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 1073741824 Nov 05 03:57:50 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cac700-92d6-4344-b9d3-c8d69996f8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb (0244cf83-c345-4fdb-83a3-c0782e1f7beb): created successfully Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cac700-92d6-4344-b9d3-c8d69996f8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (2a048fb9-f20d-423d-a072-3a6b71fb49a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f2f7c034-7863-40e0-a81e-8dcfceb6c3e5 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created volume successfully. Nov 05 03:57:50 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f Nov 05 03:57:50 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:51 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f" returned: 0 in 0.391s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:51 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f Nov 05 03:57:51 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:51 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 1073741824" returned: 0 in 0.474s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:51 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 Nov 05 03:57:51 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:51 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3c31a6b9-e190-4fb4-860c-7940017a635f" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-3c31a6b9-e190-4fb4-860c-7940017a635f" released by "delete_volume" :: held 0.698s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Created reservations ['6e1ca9ba-1be4-44fd-9c59-278136ef2b82', '4dda677b-8635-41d7-aa5b-c52e7938cec8', '85e19820-ec52-49cf-b209-7a07e26d84bf', '1ee57324-307e-4742-9039-39ad117ada57'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:51 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11" returned: 0 in 0.270s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:51 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:51 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041b90a7-8151-4809-8a43-029f4887efc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8364624-67bd-452c-89dd-13090272c560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:51 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Volume volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 (7fe59d3d-d22c-4107-9d44-3dd2265f3f11): created successfully Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8364624-67bd-452c-89dd-13090272c560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Flow 'volume_create_manager' (e34d62ec-d0c3-4dd2-8e28-bb070bbb2554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-50740907-1643-4494-b7f9-351f1f5a1036 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created volume successfully. Nov 05 03:57:51 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.256s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Deleted volume successfully. Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d8185b39-82ad-4183-ad58-5e83b4f711c6 tempest-VolumesGetTest-1041637792 None] Lock "cinder-3c31a6b9-e190-4fb4-860c-7940017a635f-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-a1bc734f-ad86-46dc-be61-a5d10eb7ac76-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Lock "cinder-a1bc734f-ad86-46dc-be61-a5d10eb7ac76-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Acquiring lock "cinder-quobyte-a1bc734f-ad86-46dc-be61-a5d10eb7ac76" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-a1bc734f-ad86-46dc-be61-a5d10eb7ac76" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aadea9-9feb-4706-96be-9ce7c8108b86]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 Nov 05 03:57:52 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:52 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76" returned: 0 in 0.366s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76 Nov 05 03:57:52 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-7fe59d3d-d22c-4107-9d44-3dd2265f3f11-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-7fe59d3d-d22c-4107-9d44-3dd2265f3f11-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-quobyte-7fe59d3d-d22c-4107-9d44-3dd2265f3f11" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-7fe59d3d-d22c-4107-9d44-3dd2265f3f11" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f02d6d-7383-4f4f-b72a-ba721d76545b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a1bc734f-ad86-46dc-be61-a5d10eb7ac76" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Lock "cinder-quobyte-a1bc734f-ad86-46dc-be61-a5d10eb7ac76" released by "delete_volume" :: held 0.681s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:52 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 Nov 05 03:57:52 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Created reservations ['78b4a445-d23f-4a0d-8b2e-c2bcf94ef9b0', 'b3d42af4-7285-44df-b70a-2ef93fc5df9d', '507ecbd2-546e-4b98-9ad0-177c386b0d5b', '6ae89b6d-4244-405a-90fb-5276cdc8ac43'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:52 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:52 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11" returned: 0 in 0.364s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11 Nov 05 03:57:52 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:53 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.269s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Deleted volume successfully. Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-25334398-ab20-4e8c-ac30-c07eb1dd5d38 tempest-VolumesGetTest-1041637792 None] Lock "cinder-a1bc734f-ad86-46dc-be61-a5d10eb7ac76-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:53 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7fe59d3d-d22c-4107-9d44-3dd2265f3f11" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-7fe59d3d-d22c-4107-9d44-3dd2265f3f11" released by "delete_volume" :: held 0.713s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created reservations ['5cdaac70-1c45-4b74-9609-7a1c35a12f4d', '666c1bc3-75a1-4b6a-a8c6-9b555064683c', '94f326bb-a78e-46c6-abe8-5231bac6aedf', '3f55d784-0d95-4ea0-b6cf-63e3b7a632aa'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:53 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:53 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-0244cf83-c345-4fdb-83a3-c0782e1f7beb-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:53 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.287s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-0244cf83-c345-4fdb-83a3-c0782e1f7beb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Deleted volume successfully. Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6e802e8f-3467-41f6-aae1-41cacd98d8b0 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-7fe59d3d-d22c-4107-9d44-3dd2265f3f11-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-quobyte-0244cf83-c345-4fdb-83a3-c0782e1f7beb" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-0244cf83-c345-4fdb-83a3-c0782e1f7beb" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f019906d-b008-49a2-93d5-6da1d82b9da1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:53 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb Nov 05 03:57:53 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:54 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb" returned: 0 in 0.391s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:54 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb Nov 05 03:57:54 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:54 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-0244cf83-c345-4fdb-83a3-c0782e1f7beb" returned: 0 in 0.300s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-0244cf83-c345-4fdb-83a3-c0782e1f7beb" released by "delete_volume" :: held 0.734s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created reservations ['424ee083-46a2-4ba9-9f88-e1bc7fb8a97f', '84feb521-8978-4be2-a21b-4206e643ab5e', '4eb9ac35-68d0-4d50-b668-14aca05aecaa', '497797d9-0377-48b8-b1e2-86998685904c'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:54 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:54 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-9843437d-d943-448b-ba8a-625bbd6ac760-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-9843437d-d943-448b-ba8a-625bbd6ac760-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:54 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.269s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:54 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Deleted volume successfully. Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-quobyte-9843437d-d943-448b-ba8a-625bbd6ac760" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-21b0ad9b-da30-46d8-8789-62c998171f34 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-0244cf83-c345-4fdb-83a3-c0782e1f7beb-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-9843437d-d943-448b-ba8a-625bbd6ac760" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eca067-bde8-4470-8131-c347b7f33416]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:55 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 Nov 05 03:57:55 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:55 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760" returned: 0 in 0.364s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:55 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760 Nov 05 03:57:55 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:55 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9843437d-d943-448b-ba8a-625bbd6ac760" returned: 0 in 0.266s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-9843437d-d943-448b-ba8a-625bbd6ac760" released by "delete_volume" :: held 0.679s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created reservations ['39cc35a5-13bd-436d-92f6-fcc980781226', '26c349cb-a0d9-4577-9adf-6090658d3061', 'eec477b2-c687-4bc2-8669-1f24d433e46e', '0fc3ff8f-1ef1-48ce-b7ed-1f3de61871db'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:55 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:55 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:56 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.282s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Deleted volume successfully. Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7ff9020c-84a5-4d5a-92d6-31b776bcbbee tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-9843437d-d943-448b-ba8a-625bbd6ac760-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-quobyte-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f33dd4a-087c-42d5-beee-b2bad6d94cd9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:56 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 Nov 05 03:57:56 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:56 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014" returned: 0 in 0.364s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:56 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014 Nov 05 03:57:56 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:56 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014" returned: 0 in 0.280s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014" released by "delete_volume" :: held 0.692s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created reservations ['2f29ec09-eaa8-458d-8abe-4e49418b3380', '5d80e541-33f1-4b26-9f6d-0d3cad61e114', 'cf1f5d38-a485-448d-9b5e-b20acb60c8b4', '43b33c6a-c9b2-4491-a46b-5f8751f85da1'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:56 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:56 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Flow 'volume_create_manager' (f91fb495-47f6-4b07-bdc1-e9b776c8c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b54d9c-97ec-43d6-b19c-9e632e790961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-b9467656-5fe9-4496-ad12-bf9d8ae52eda-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b54d9c-97ec-43d6-b19c-9e632e790961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2138269435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560fe286-9607-4771-bd0a-7b04c4a3a60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b87f1570124845aeb26ea4badde53cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:57Z,use_quota=True,user_id='ebf2e8bd75e34fd0bceb61772e424faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56524ad1-cb5a-497e-9819-0aae422ed9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56524ad1-cb5a-497e-9819-0aae422ed9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9527c3-a66f-43dc-9e62-b1c3393dddb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9527c3-a66f-43dc-9e62-b1c3393dddb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560fe286-9607-4771-bd0a-7b04c4a3a60c', 'volume_name': 'volume-560fe286-9607-4771-bd0a-7b04c4a3a60c', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1bb812-7f1b-42d8-9dbe-0cd1f5f9466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:57 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1bb812-7f1b-42d8-9dbe-0cd1f5f9466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89769575-97c7-4fec-82c5-19ed65e50e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:57 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Volume 560fe286-9607-4771-bd0a-7b04c4a3a60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560fe286-9607-4771-bd0a-7b04c4a3a60c', 'volume_size': 1} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2138269435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560fe286-9607-4771-bd0a-7b04c4a3a60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b87f1570124845aeb26ea4badde53cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:57Z,use_quota=True,user_id='ebf2e8bd75e34fd0bceb61772e424faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Creating volume 560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:57 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.342s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-b9467656-5fe9-4496-ad12-bf9d8ae52eda-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Deleted volume successfully. Nov 05 03:57:57 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c 1073741824 Nov 05 03:57:57 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4303d51e-1dde-467e-81c1-51317771dd08 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-1ebc13d7-e8aa-4cdd-9e07-1be4f0e51014-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-quobyte-b9467656-5fe9-4496-ad12-bf9d8ae52eda" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-b9467656-5fe9-4496-ad12-bf9d8ae52eda" acquired by "delete_volume" :: waited 0.013s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b638d-b424-415e-95f3-83d237dbe1a9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:57 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda Nov 05 03:57:57 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:57 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c 1073741824" returned: 0 in 0.451s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:57 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c Nov 05 03:57:57 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:57 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda" returned: 0 in 0.433s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:57 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda Nov 05 03:57:57 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:58 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c" returned: 0 in 0.276s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89769575-97c7-4fec-82c5-19ed65e50e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560fe286-9607-4771-bd0a-7b04c4a3a60c', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26611a1-f2dd-4ce1-9cea-0d6a54085687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:58 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Volume volume-560fe286-9607-4771-bd0a-7b04c4a3a60c (560fe286-9607-4771-bd0a-7b04c4a3a60c): created successfully Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26611a1-f2dd-4ce1-9cea-0d6a54085687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:58 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Flow 'volume_create_manager' (f91fb495-47f6-4b07-bdc1-e9b776c8c268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b9467656-5fe9-4496-ad12-bf9d8ae52eda" returned: 0 in 0.263s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-b9467656-5fe9-4496-ad12-bf9d8ae52eda" released by "delete_volume" :: held 0.738s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-955cb2cf-23e1-401b-a779-bf6c7751fbe3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Created volume successfully. Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created reservations ['64c95413-9038-492a-b310-307919ca5cb2', '5f72d4a8-43e6-492b-887d-aa4e5271240a', 'b66df627-449e-495a-b493-510444196fc1', '20150a1b-bd2b-45f9-822a-077d530f5dd2'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:58 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:58 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "cinder-quobyte-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:58 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.273s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Deleted volume successfully. Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[61060434-bacb-4e65-9af6-2cdccecca4a6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-32cf7505-e870-4213-8f90-1844b855a190 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-b9467656-5fe9-4496-ad12-bf9d8ae52eda-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:58 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 Nov 05 03:57:58 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:58 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0" returned: 0 in 0.378s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:58 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0 Nov 05 03:57:58 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:59 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0" returned: 0 in 0.250s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-quobyte-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0" released by "delete_volume" :: held 0.681s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Created reservations ['09087d22-7758-4f88-b8dd-90a581c8e9f1', '3bbc8ffc-9da5-4cf3-a06b-4a261acf9e9c', '0b294e08-5587-4b21-aefe-336c18733bd8', '7eb5be80-70b1-4372-b257-9d03772c57b6'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:59 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:57:59 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Creating offline snapshot bbef12f8-deeb-48f1-93f8-c202e407bb61 of volume 560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8031c25-f919-41f0-9399-90b9844fdfb9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:59 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c Nov 05 03:57:59 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:59 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.282s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Deleted volume successfully. Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce964b08-5919-4f6b-8b22-3e686f7e0867 tempest-CreateVolumesFromSourceVolumeTest-283956428 None] Lock "cinder-74f7ba2e-ff83-4b2c-9474-ec7486e9f7f0-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:59 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c" returned: 0 in 0.426s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:59 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 1G Nov 05 03:57:59 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:00 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 1G" returned: 0 in 0.469s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:00 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 Nov 05 03:58:00 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:00 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61" returned: 0 in 0.322s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:00 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 is being set with open permissions: ugo+rw Nov 05 03:58:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:00 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 Nov 05 03:58:00 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:00 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61" returned: 0 in 0.261s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:00 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.info Nov 05 03:58:00 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:01 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.info" returned: 0 in 0.260s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:01 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.info is being set with open permissions: ugo+rw Nov 05 03:58:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:01 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.info Nov 05 03:58:01 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:01 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.info" returned: 0 in 0.255s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-94a71383-607f-49b6-86b7-840f51b2e2d0 tempest-VolumesSnapshotListTestJSON-1071511293 None] Create snapshot completed successfully Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Flow 'volume_create_manager' (78eb945b-70b3-447f-abc1-ebc2a198124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70530c63-aec4-4b36-88b4-2f7c0381f817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70530c63-aec4-4b36-88b4-2f7c0381f817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a339c2-ac57-407b-9bd8-4dd59d0f3db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36dafd056be47d8a4c221426c4c8b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:02Z,use_quota=True,user_id='fabfce2a359f4f4584e1bf67392cc3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013138f3-76da-436e-867d-b6c1da24f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013138f3-76da-436e-867d-b6c1da24f63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ffece9-d12a-435e-9bf1-fb9d4ed0205e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ffece9-d12a-435e-9bf1-fb9d4ed0205e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a339c2-ac57-407b-9bd8-4dd59d0f3db5', 'volume_name': 'volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ecd430-3e3f-44f8-912c-d4d2e51f4a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ecd430-3e3f-44f8-912c-d4d2e51f4a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb6f1a-072b-4b44-9d63-4e4a6fd60909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:02 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Volume a5a339c2-ac57-407b-9bd8-4dd59d0f3db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5', 'volume_size': 1} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a339c2-ac57-407b-9bd8-4dd59d0f3db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36dafd056be47d8a4c221426c4c8b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:02Z,use_quota=True,user_id='fabfce2a359f4f4584e1bf67392cc3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Creating volume a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:58:02 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:02 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 1073741824 Nov 05 03:58:02 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:03 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 1073741824" returned: 0 in 0.419s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:03 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 Nov 05 03:58:03 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:03 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5" returned: 0 in 0.245s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.600s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb6f1a-072b-4b44-9d63-4e4a6fd60909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b084e4-a6ea-44db-bdb6-857a235785c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Creating offline snapshot ff22516c-2ba8-494f-9ead-46913b08d470 of volume 560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:58:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Volume volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 (a5a339c2-ac57-407b-9bd8-4dd59d0f3db5): created successfully Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b084e4-a6ea-44db-bdb6-857a235785c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Flow 'volume_create_manager' (78eb945b-70b3-447f-abc1-ebc2a198124c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[085bbdac-9fc3-4ef8-922b-d87e1b4c059c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:03 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-da140ebb-1b8b-4222-a669-496905d65564 tempest-CinderUnicodeTest-873332227 None] Created volume successfully. Nov 05 03:58:03 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 Nov 05 03:58:03 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:03 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61" returned: 0 in 0.395s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560fe286-9607-4771-bd0a-7b04c4a3a60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:03 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 1G Nov 05 03:58:03 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:04 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 1G" returned: 0 in 0.441s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:04 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 Nov 05 03:58:04 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:04 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:04 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 is being set with open permissions: ugo+rw Nov 05 03:58:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:04 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 Nov 05 03:58:04 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:04 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470" returned: 0 in 0.258s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.561s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:05 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f8fc567c-0e2b-4185-8e35-2b3b6bd49652 tempest-VolumesSnapshotListTestJSON-1071511293 None] Create snapshot completed successfully Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Flow 'volume_create_manager' (cae6b9b3-8bfb-4e3b-aeb5-aa2a11506e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb9ef08-222b-45cd-84cf-8f4e54879d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb9ef08-222b-45cd-84cf-8f4e54879d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:58:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-589958227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d523b276-acd4-4521-93f7-e3f32951184d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36dafd056be47d8a4c221426c4c8b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:05Z,use_quota=True,user_id='fabfce2a359f4f4584e1bf67392cc3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55dc7d8-6377-43a7-8b02-854e378e3ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55dc7d8-6377-43a7-8b02-854e378e3ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e17e03c-e8e2-430e-807e-7612d25aa747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e17e03c-e8e2-430e-807e-7612d25aa747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd523b276-acd4-4521-93f7-e3f32951184d', 'volume_name': 'volume-d523b276-acd4-4521-93f7-e3f32951184d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d6ec53-5802-4bce-a656-1666a7ae10b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d6ec53-5802-4bce-a656-1666a7ae10b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408acb10-dc1b-4d0f-a144-7cbe379c2482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:05 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Volume d523b276-acd4-4521-93f7-e3f32951184d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d523b276-acd4-4521-93f7-e3f32951184d', 'volume_size': 1} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:58:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-589958227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d523b276-acd4-4521-93f7-e3f32951184d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36dafd056be47d8a4c221426c4c8b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:05Z,use_quota=True,user_id='fabfce2a359f4f4584e1bf67392cc3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Creating volume d523b276-acd4-4521-93f7-e3f32951184d {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:58:05 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:05 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d 1073741824 Nov 05 03:58:05 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:05 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d 1073741824" returned: 0 in 0.425s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:05 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d Nov 05 03:58:05 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:05 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d" returned: 0 in 0.250s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408acb10-dc1b-4d0f-a144-7cbe379c2482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d523b276-acd4-4521-93f7-e3f32951184d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d564f745-2de6-4fc1-81f6-931e5192c226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:06 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Volume volume-d523b276-acd4-4521-93f7-e3f32951184d (d523b276-acd4-4521-93f7-e3f32951184d): created successfully Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d564f745-2de6-4fc1-81f6-931e5192c226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Flow 'volume_create_manager' (cae6b9b3-8bfb-4e3b-aeb5-aa2a11506e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:58:06 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6da30c84-3319-4658-b97b-af7a43931ee4 tempest-CinderUnicodeTest-873332227 None] Created volume successfully. Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Creating offline snapshot 0fc33c34-5515-4068-8818-17cc5f09f5cb of volume 560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1d9226-9b31-47d2-9faf-67609f325648]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:06 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 Nov 05 03:58:06 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:06 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560fe286-9607-4771-bd0a-7b04c4a3a60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:06 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb 1G Nov 05 03:58:06 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:07 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb 1G" returned: 0 in 0.488s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:07 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb Nov 05 03:58:07 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:07 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb" returned: 0 in 0.371s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:07 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb is being set with open permissions: ugo+rw Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:07 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb Nov 05 03:58:07 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:07 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb" returned: 0 in 0.255s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.645s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.354s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Creating offline snapshot 5418c2f0-ea95-4617-b67e-230ab7fd3d34 of volume d523b276-acd4-4521-93f7-e3f32951184d {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:58:07 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8bd7ae92-542d-4601-b61b-211a58a5bae3 tempest-VolumesSnapshotListTestJSON-1071511293 None] Create snapshot completed successfully Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[257544cb-70ae-44e6-8dc7-791c8d865e65]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:08 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d Nov 05 03:58:08 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:08 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d" returned: 0 in 0.424s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:08 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 1G Nov 05 03:58:08 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:08 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 1G" returned: 0 in 0.474s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d523b276-acd4-4521-93f7-e3f32951184d -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:08 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d523b276-acd4-4521-93f7-e3f32951184d -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 Nov 05 03:58:08 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:09 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d523b276-acd4-4521-93f7-e3f32951184d -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34" returned: 0 in 0.316s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:09 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 is being set with open permissions: ugo+rw Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:09 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 Nov 05 03:58:09 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-0fc33c34-5515-4068-8818-17cc5f09f5cb-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-0fc33c34-5515-4068-8818-17cc5f09f5cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-quobyte-0fc33c34-5515-4068-8818-17cc5f09f5cb" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-0fc33c34-5515-4068-8818-17cc5f09f5cb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:09 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Deleting offline snapshot 0fc33c34-5515-4068-8818-17cc5f09f5cb of volume 560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] snapshot_file for this snap is: volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34" returned: 0 in 0.307s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f89b46-f35e-42f4-9a24-2d02e68b7f15]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:09 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.info Nov 05 03:58:09 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:09 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb Nov 05 03:58:09 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:09 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.info" returned: 0 in 0.275s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:09 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.info is being set with open permissions: ugo+rw Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:09 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.info Nov 05 03:58:09 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:09 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb" returned: 0 in 0.396s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560fe286-9607-4771-bd0a-7b04c4a3a60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[175f7961-b60b-41a7-a2bd-fdba5748a9ba]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:09 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 Nov 05 03:58:09 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:10 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.info" returned: 0 in 0.277s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d2ac5fa4-ad26-43bb-944b-4c86f31fd387 tempest-CinderUnicodeTest-873332227 None] Create snapshot completed successfully Nov 05 03:58:10 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470" returned: 0 in 0.377s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560fe286-9607-4771-bd0a-7b04c4a3a60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:10 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb Nov 05 03:58:10 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:10 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb" returned: 0 in 0.399s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:10 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb Nov 05 03:58:10 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "cinder-5418c2f0-ea95-4617-b67e-230ab7fd3d34-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-5418c2f0-ea95-4617-b67e-230ab7fd3d34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "cinder-quobyte-d523b276-acd4-4521-93f7-e3f32951184d" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-quobyte-d523b276-acd4-4521-93f7-e3f32951184d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "cinder-quobyte-5418c2f0-ea95-4617-b67e-230ab7fd3d34" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-quobyte-5418c2f0-ea95-4617-b67e-230ab7fd3d34" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Deleting offline snapshot 5418c2f0-ea95-4617-b67e-230ab7fd3d34 of volume d523b276-acd4-4521-93f7-e3f32951184d {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] snapshot_file for this snap is: volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[871c633e-301a-4242-b7c4-40358c53c44f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:10 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.0fc33c34-5515-4068-8818-17cc5f09f5cb" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-0fc33c34-5515-4068-8818-17cc5f09f5cb" released by "_delete_snapshot" :: held 1.536s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" released by "delete_snapshot" :: held 1.562s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:10 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 Nov 05 03:58:10 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Created reservations ['009ad80e-3085-475e-8c0d-b59548d412fe', 'ffec51b6-fd11-438a-aa7d-af6728ee6ff6', '8a089f7f-ba99-490a-9189-f16d05d0a0b9', '372e2bc9-deab-4ef9-955c-3925ff8fbb99'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:58:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Delete snapshot completed successfully. Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-924c2ae1-a810-4970-9609-60e88b546a76 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-0fc33c34-5515-4068-8818-17cc5f09f5cb-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:11 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34" returned: 0 in 0.387s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d523b276-acd4-4521-93f7-e3f32951184d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff36297-e1ce-4749-8a2d-1a9434276e83]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:11 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d Nov 05 03:58:11 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-ff22516c-2ba8-494f-9ead-46913b08d470-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-ff22516c-2ba8-494f-9ead-46913b08d470-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-quobyte-ff22516c-2ba8-494f-9ead-46913b08d470" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-ff22516c-2ba8-494f-9ead-46913b08d470" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Deleting offline snapshot ff22516c-2ba8-494f-9ead-46913b08d470 of volume 560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] snapshot_file for this snap is: volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[53890ef1-7930-4efa-9a21-51299c28615e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:11 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d" returned: 0 in 0.377s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:11 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 Nov 05 03:58:11 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:11 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 Nov 05 03:58:11 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:11 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470" returned: 0 in 0.375s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560fe286-9607-4771-bd0a-7b04c4a3a60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e628de-f241-48fc-b76f-7bc405ec0d70]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:12 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34" returned: 0 in 0.391s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:12 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34 Nov 05 03:58:12 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:12 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 Nov 05 03:58:12 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:12 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d.5418c2f0-ea95-4617-b67e-230ab7fd3d34" returned: 0 in 0.274s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-quobyte-5418c2f0-ea95-4617-b67e-230ab7fd3d34" released by "_delete_snapshot" :: held 1.546s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-quobyte-d523b276-acd4-4521-93f7-e3f32951184d" released by "delete_snapshot" :: held 1.569s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Created reservations ['6a54b629-8355-415d-8bfe-f6e31a648b7f', '12fdf384-d3c4-49b0-8d96-78d3771aa50f', 'b833b703-5ab0-49bd-87c7-f720a232aaeb', 'f191d256-d209-4b85-b4fc-5658cb8ff62a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:58:12 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61" returned: 0 in 0.492s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560fe286-9607-4771-bd0a-7b04c4a3a60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:12 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Delete snapshot completed successfully. Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-529629cb-5f3c-4b8d-813d-57692829cbb4 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-5418c2f0-ea95-4617-b67e-230ab7fd3d34-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:12 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 Nov 05 03:58:12 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:12 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470" returned: 0 in 0.402s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Acquiring lock "cinder-d523b276-acd4-4521-93f7-e3f32951184d-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:12 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470 Nov 05 03:58:12 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Lock "cinder-d523b276-acd4-4521-93f7-e3f32951184d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Acquiring lock "cinder-quobyte-d523b276-acd4-4521-93f7-e3f32951184d" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Lock "cinder-quobyte-d523b276-acd4-4521-93f7-e3f32951184d" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d549fe3-7b41-41b5-bb88-e334cf00f436]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:13 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d Nov 05 03:58:13 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:13 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.ff22516c-2ba8-494f-9ead-46913b08d470" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-ff22516c-2ba8-494f-9ead-46913b08d470" released by "_delete_snapshot" :: held 1.673s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" released by "delete_snapshot" :: held 1.700s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Created reservations ['992cd444-4785-4aa4-a80e-77797b452724', 'c1692318-4f46-4101-ab7b-def6e8ecc8c9', 'eb32694f-7667-4533-82a7-ad50c20d1b0e', 'a9824d25-323a-45dd-bf2d-b177ed92646a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:58:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Delete snapshot completed successfully. Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e9615b8e-7256-4706-8633-5b6cd0e9d011 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-ff22516c-2ba8-494f-9ead-46913b08d470-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:13 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d" returned: 0 in 0.380s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:13 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d Nov 05 03:58:13 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-bbef12f8-deeb-48f1-93f8-c202e407bb61-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-bbef12f8-deeb-48f1-93f8-c202e407bb61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-quobyte-bbef12f8-deeb-48f1-93f8-c202e407bb61" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:13 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-d523b276-acd4-4521-93f7-e3f32951184d" returned: 0 in 0.287s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-bbef12f8-deeb-48f1-93f8-c202e407bb61" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Deleting offline snapshot bbef12f8-deeb-48f1-93f8-c202e407bb61 of volume 560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] snapshot_file for this snap is: volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Lock "cinder-quobyte-d523b276-acd4-4521-93f7-e3f32951184d" released by "delete_volume" :: held 0.761s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[512f62fb-16f7-412d-86e0-9ed33728fe60]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Created reservations ['a0da1767-bfac-4049-baa7-7053923710a3', 'd281186c-dd56-48f5-8abe-ac72baf33f65', '0cd4772d-0d15-403a-97e9-932e7342bf7e', '7727c787-ceff-4210-acba-4591ee0b8278'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:58:13 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 Nov 05 03:58:13 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:13 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:58:13 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "cinder-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "cinder-quobyte-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-quobyte-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:14 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:14 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61" returned: 0 in 0.435s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560fe286-9607-4771-bd0a-7b04c4a3a60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d742853-b80f-4fe5-8516-5b5d1537a1b0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.333s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c9bb4-8f94-43a3-8919-8f7e62136e81]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Deleted volume successfully. Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a835fda1-d990-4444-ae5c-54fa173e9abc tempest-CinderUnicodeTest-873332227 None] Lock "cinder-d523b276-acd4-4521-93f7-e3f32951184d-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:14 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 Nov 05 03:58:14 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:14 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c Nov 05 03:58:14 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:14 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5" returned: 0 in 0.389s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:14 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c" returned: 0 in 0.390s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:14 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5 Nov 05 03:58:14 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:14 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 Nov 05 03:58:14 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:14 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5" returned: 0 in 0.260s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-quobyte-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5" released by "delete_volume" :: held 0.713s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:14 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Created reservations ['76608427-0023-4769-93c0-174975790102', '2e48fd07-5486-4c89-9e57-79472bd2fd64', '0e2334c1-21c5-4da0-803c-c3f2f8fa5bc9', '0dd6618e-fb4a-4c3c-b20a-f98f5aacae4f'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:58:15 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61" returned: 0 in 0.337s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:15 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61 Nov 05 03:58:15 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:15 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:58:15 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:15 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c.bbef12f8-deeb-48f1-93f8-c202e407bb61" returned: 0 in 0.283s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:15 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:58:15 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-bbef12f8-deeb-48f1-93f8-c202e407bb61" released by "_delete_snapshot" :: held 1.593s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:15 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" released by "delete_snapshot" :: held 1.632s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.300s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:58:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Deleted volume successfully. Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ff9c28c1-9742-4268-8433-a2b10c2f4395 tempest-CinderUnicodeTest-873332227 None] Lock "cinder-a5a339c2-ac57-407b-9bd8-4dd59d0f3db5-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Created reservations ['cb47fe09-c8b5-4eb8-830b-6c90f77734d3', 'caf261e3-c193-4d7d-92dc-db9cc30af5fa', '2ef55ea1-bd87-407d-b67b-4fab5ea59d52', '7b768183-ab0f-4f8c-9941-c12e7241b675'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:58:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Delete snapshot completed successfully. Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5dd90af4-3f33-4cc0-8fbd-dfd6e4640480 tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-bbef12f8-deeb-48f1-93f8-c202e407bb61-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:15 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.313s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-560fe286-9607-4771-bd0a-7b04c4a3a60c-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-560fe286-9607-4771-bd0a-7b04c4a3a60c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4da370-7e47-4987-92b1-f7a24e0253f7]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:16 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c Nov 05 03:58:16 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:16 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c" returned: 0 in 0.395s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:16 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c Nov 05 03:58:16 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:16 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-560fe286-9607-4771-bd0a-7b04c4a3a60c" returned: 0 in 0.288s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-quobyte-560fe286-9607-4771-bd0a-7b04c4a3a60c" released by "delete_volume" :: held 0.773s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Created reservations ['ec0bd577-51e3-47b5-9d6b-ce80bf366c82', '78f69088-976c-406b-bc54-758b8c26f2bf', 'eacb12da-94c6-4010-99d9-2008346c8f9a', '10b94697-1b2d-4880-8dbc-114a6ee817b6'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:16 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:58:16 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:17 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.285s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:17 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:58:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Deleted volume successfully. Nov 05 03:58:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b78e71bc-20d8-4d5e-a2f6-dc853884902c tempest-VolumesSnapshotListTestJSON-1071511293 None] Lock "cinder-560fe286-9607-4771-bd0a-7b04c4a3a60c-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:26 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=267,cinder:SELECT=194,cinder:INSERT=67,cinder:DELETE=21 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:58:27 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=123,cinder:INSERT=45,cinder:UPDATE=133,cinder:DELETE=15 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:58:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:59:11 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Flow 'volume_create_manager' (cf14643a-42ce-4403-bfb7-9791e3a17981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdf5aeb-9c35-4074-80ee-4be8e02d76a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdf5aeb-9c35-4074-80ee-4be8e02d76a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-374320923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4462264-b011-4272-b166-5ce3380d5952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6af7d05c91450580433f1cae760807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:12Z,use_quota=True,user_id='80d0ad52ba634b3290a9e18f7daba9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a45b75-721b-4685-9e9a-5eb3255b80b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a45b75-721b-4685-9e9a-5eb3255b80b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb58454-f916-40b3-af09-bca8d5ec636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb58454-f916-40b3-af09-bca8d5ec636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4462264-b011-4272-b166-5ce3380d5952', 'volume_name': 'volume-c4462264-b011-4272-b166-5ce3380d5952', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82476871-1287-48fd-817e-84dfb72ed0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82476871-1287-48fd-817e-84dfb72ed0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d53a14-ef64-41c1-a1ff-d84557d33dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Volume c4462264-b011-4272-b166-5ce3380d5952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4462264-b011-4272-b166-5ce3380d5952', 'volume_size': 1} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-374320923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4462264-b011-4272-b166-5ce3380d5952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6af7d05c91450580433f1cae760807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:12Z,use_quota=True,user_id='80d0ad52ba634b3290a9e18f7daba9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Creating volume c4462264-b011-4272-b166-5ce3380d5952 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:59:12 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:12 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 1073741824 Nov 05 03:59:12 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:12 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 1073741824" returned: 0 in 0.490s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:12 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 Nov 05 03:59:12 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:12 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d53a14-ef64-41c1-a1ff-d84557d33dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4462264-b011-4272-b166-5ce3380d5952', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86297160-7f84-4691-b87f-444b4d7ed596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Volume volume-c4462264-b011-4272-b166-5ce3380d5952 (c4462264-b011-4272-b166-5ce3380d5952): created successfully Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86297160-7f84-4691-b87f-444b4d7ed596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Flow 'volume_create_manager' (cf14643a-42ce-4403-bfb7-9791e3a17981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:12 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ea71645e-1c58-4d00-a476-8dd54343a768 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Created volume successfully. Nov 05 03:59:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1aed562f-a7da-4515-a282-92ae26e4dd83 req-e6c1c1f7-a5be-41ce-879d-2296fef1fdb8 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1aed562f-a7da-4515-a282-92ae26e4dd83 req-e6c1c1f7-a5be-41ce-879d-2296fef1fdb8 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1aed562f-a7da-4515-a282-92ae26e4dd83 req-e6c1c1f7-a5be-41ce-879d-2296fef1fdb8 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-1aed562f-a7da-4515-a282-92ae26e4dd83 req-e6c1c1f7-a5be-41ce-879d-2296fef1fdb8 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-c4462264-b011-4272-b166-5ce3380d5952', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd7533a6-e26f-45a2-934f-a6f47853fe1d', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:59:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-1aed562f-a7da-4515-a282-92ae26e4dd83 req-e6c1c1f7-a5be-41ce-879d-2296fef1fdb8 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] attachment_update completed successfully. Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:15 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:59:15 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:15 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.270s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:59:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:59:16 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-fd56ac70-e048-4e1a-a850-2581707a2e50 req-69d2cf5e-fe2b-4274-a0cc-5ea3528716a8 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Terminate volume connection completed successfully. Nov 05 03:59:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-fd56ac70-e048-4e1a-a850-2581707a2e50 req-69d2cf5e-fe2b-4274-a0cc-5ea3528716a8 tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Deleting attachment bd7533a6-e26f-45a2-934f-a6f47853fe1d. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:59:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Acquiring lock "cinder-c4462264-b011-4272-b166-5ce3380d5952-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "cinder-c4462264-b011-4272-b166-5ce3380d5952-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Acquiring lock "cinder-quobyte-c4462264-b011-4272-b166-5ce3380d5952" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "cinder-quobyte-c4462264-b011-4272-b166-5ce3380d5952" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:17 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72c4728-9192-4f63-a839-d26cd0b22036]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:18 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 Nov 05 03:59:18 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:18 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952" returned: 0 in 0.371s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:18 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952 Nov 05 03:59:18 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:18 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c4462264-b011-4272-b166-5ce3380d5952" returned: 0 in 0.238s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "cinder-quobyte-c4462264-b011-4272-b166-5ce3380d5952" released by "delete_volume" :: held 0.655s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Created reservations ['15028f0e-7aaf-4f8f-8181-a7463e79756b', 'f476ed8d-b0e8-4ea5-81ca-7021c9403b70', 'e340b681-edfe-40a8-98bb-e0e3b23358ae', 'af6d93f6-b765-4fa5-9d80-a1a94ef8b280'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:18 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 03:59:18 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:18 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Deleted volume successfully. Nov 05 03:59:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f0a87338-fbcb-4623-80d8-b6b1331d1b1f tempest-TestServerVolumeAttachScenarioOldVersion-1604894863 None] Lock "cinder-c4462264-b011-4272-b166-5ce3380d5952-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:28 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:59:28 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=14,cinder:INSERT=2,cinder:SELECT=13,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Flow 'volume_create_manager' (b3387448-9298-4430-8711-cdd3a4be6b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88a04b0-1030-4e77-b43e-9a0137910f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88a04b0-1030-4e77-b43e-9a0137910f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-617557470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfdb6a05a549338fcecf3042d72ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:52Z,use_quota=True,user_id='98b62ab90fd14e47854a31d1f4011a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc489c5a-08e5-426b-aa28-513b54fb71a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc489c5a-08e5-426b-aa28-513b54fb71a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5925f1e3-64ec-447d-823e-60450c95eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5925f1e3-64ec-447d-823e-60450c95eae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8', 'volume_name': 'volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34304d0-b974-48a9-bbc1-2860ec6231af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34304d0-b974-48a9-bbc1-2860ec6231af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94149c62-f00e-4475-87b4-0b63f74842f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Volume b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8', 'volume_size': 1} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-617557470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfdb6a05a549338fcecf3042d72ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:52Z,use_quota=True,user_id='98b62ab90fd14e47854a31d1f4011a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Creating volume b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:59:52 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:52 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 1073741824 Nov 05 03:59:52 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Flow 'volume_create_manager' (d1fc9cbd-6f94-4ff3-8016-1e04c3c4b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a59fab0-6492-483f-b6f6-cc5612585ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a59fab0-6492-483f-b6f6-cc5612585ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-877190629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e23e3e-0c7d-4abf-98c9-e74b08ccb852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfdb6a05a549338fcecf3042d72ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:53Z,use_quota=True,user_id='98b62ab90fd14e47854a31d1f4011a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91941fde-be4c-4397-bd0d-214799c93c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91941fde-be4c-4397-bd0d-214799c93c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a77092f-f3d7-46f4-bde1-0b3585fb60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a77092f-f3d7-46f4-bde1-0b3585fb60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e23e3e-0c7d-4abf-98c9-e74b08ccb852', 'volume_name': 'volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25460ad-5441-467d-846e-876fe557716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25460ad-5441-467d-846e-876fe557716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674605c7-29f8-4438-9589-656b0856da81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Volume 21e23e3e-0c7d-4abf-98c9-e74b08ccb852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852', 'volume_size': 1} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:52 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 1073741824" returned: 0 in 0.501s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:52 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 Nov 05 03:59:52 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:53 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8" returned: 0 in 0.249s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.411s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-877190629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e23e3e-0c7d-4abf-98c9-e74b08ccb852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfdb6a05a549338fcecf3042d72ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:53Z,use_quota=True,user_id='98b62ab90fd14e47854a31d1f4011a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Creating volume 21e23e3e-0c7d-4abf-98c9-e74b08ccb852 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:59:53 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94149c62-f00e-4475-87b4-0b63f74842f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:53 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 1073741824 Nov 05 03:59:53 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f5bfa2-b91b-4d49-ae9a-03a63d3d9fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:53 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Volume volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 (b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8): created successfully Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f5bfa2-b91b-4d49-ae9a-03a63d3d9fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Flow 'volume_create_manager' (b3387448-9298-4430-8711-cdd3a4be6b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-39864b49-2f25-4abd-a44f-c9840d464f61 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Created volume successfully. Nov 05 03:59:53 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 1073741824" returned: 0 in 0.496s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:53 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 Nov 05 03:59:53 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:53 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852" returned: 0 in 0.286s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674605c7-29f8-4438-9589-656b0856da81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6054dea-d8b8-4f57-9c64-db4d695fc097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Volume volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 (21e23e3e-0c7d-4abf-98c9-e74b08ccb852): created successfully Nov 05 03:59:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6054dea-d8b8-4f57-9c64-db4d695fc097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Flow 'volume_create_manager' (d1fc9cbd-6f94-4ff3-8016-1e04c3c4b68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:54 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ebd15288-146d-4c14-9b9b-14e04bef6533 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Created volume successfully. Nov 05 04:00:03 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:INSERT=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:04 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:15 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:00:15 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:15 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.254s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:00:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:00:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-9c8aaf74-1842-4ade-b853-bbbb283cf805 req-15b02661-93a6-4bb6-af7a-98a85aa31e73 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-9c8aaf74-1842-4ade-b853-bbbb283cf805 req-15b02661-93a6-4bb6-af7a-98a85aa31e73 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-9c8aaf74-1842-4ade-b853-bbbb283cf805 req-15b02661-93a6-4bb6-af7a-98a85aa31e73 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-9c8aaf74-1842-4ade-b853-bbbb283cf805 req-15b02661-93a6-4bb6-af7a-98a85aa31e73 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a042556c-520d-4aee-ab36-460ab4f8f537', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 04:00:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-9c8aaf74-1842-4ade-b853-bbbb283cf805 req-15b02661-93a6-4bb6-af7a-98a85aa31e73 tempest-TestServerVolumeAttachmentScenario-1665606173 None] attachment_update completed successfully. Nov 05 04:00:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-33843cc6-33d3-425f-bcc3-aa342526e2a2 req-dfa4a669-d1bd-4c85-8582-0bfc86b6d9b4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-33843cc6-33d3-425f-bcc3-aa342526e2a2 req-dfa4a669-d1bd-4c85-8582-0bfc86b6d9b4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-33843cc6-33d3-425f-bcc3-aa342526e2a2 req-dfa4a669-d1bd-4c85-8582-0bfc86b6d9b4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-33843cc6-33d3-425f-bcc3-aa342526e2a2 req-dfa4a669-d1bd-4c85-8582-0bfc86b6d9b4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44894672-7dbc-478d-838a-bdaebaa0e322', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 04:00:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-33843cc6-33d3-425f-bcc3-aa342526e2a2 req-dfa4a669-d1bd-4c85-8582-0bfc86b6d9b4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] attachment_update completed successfully. Nov 05 04:00:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-ee3f5ab0-8f60-4e76-85c6-a7852ecda444 req-29d6bafe-3b12-4aae-bf6b-cbf5857ed0cf tempest-TestServerVolumeAttachmentScenario-1665606173 None] Terminate volume connection completed successfully. Nov 05 04:00:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-ee3f5ab0-8f60-4e76-85c6-a7852ecda444 req-29d6bafe-3b12-4aae-bf6b-cbf5857ed0cf tempest-TestServerVolumeAttachmentScenario-1665606173 None] Deleting attachment 44894672-7dbc-478d-838a-bdaebaa0e322. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 04:00:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-00de1b87-23a5-454f-a62e-0a1b260f3793 req-985c4354-4747-4cc7-a493-cd2f8e80fe3e tempest-TestServerVolumeAttachmentScenario-1665606173 None] Terminate volume connection completed successfully. Nov 05 04:00:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-00de1b87-23a5-454f-a62e-0a1b260f3793 req-985c4354-4747-4cc7-a493-cd2f8e80fe3e tempest-TestServerVolumeAttachmentScenario-1665606173 None] Deleting attachment a042556c-520d-4aee-ab36-460ab4f8f537. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 04:00:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "cinder-21e23e3e-0c7d-4abf-98c9-e74b08ccb852-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:00:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "cinder-21e23e3e-0c7d-4abf-98c9-e74b08ccb852-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:00:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "cinder-quobyte-21e23e3e-0c7d-4abf-98c9-e74b08ccb852" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:00:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "cinder-quobyte-21e23e3e-0c7d-4abf-98c9-e74b08ccb852" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:00:34 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff4166-d371-42da-a63e-a8f7de67b32d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:00:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:35 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 Nov 05 04:00:35 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:35 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852" returned: 0 in 0.373s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:35 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852 Nov 05 04:00:35 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:35 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-21e23e3e-0c7d-4abf-98c9-e74b08ccb852" returned: 0 in 0.246s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "cinder-quobyte-21e23e3e-0c7d-4abf-98c9-e74b08ccb852" released by "delete_volume" :: held 0.664s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Created reservations ['eed730c4-72d0-4aac-9204-e36e42c735d3', '99614f59-15ce-4e19-a0c6-76935c0f054b', '334308f7-b643-4c9c-a1df-f6395749a285', 'fa974d1c-c61e-46de-b38f-702570a817d0'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:35 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:00:35 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:35 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.228s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:35 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:00:35 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Deleted volume successfully. Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2105b49d-9287-49fa-b0f3-7239bcb9dfa3 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "cinder-21e23e3e-0c7d-4abf-98c9-e74b08ccb852-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "cinder-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "cinder-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "cinder-quobyte-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "cinder-quobyte-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6050be-0911-4cf4-921e-b3f4942642f8]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:36 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 Nov 05 04:00:36 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:36 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8" returned: 0 in 0.359s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:36 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8 Nov 05 04:00:36 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:36 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8" returned: 0 in 0.245s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "cinder-quobyte-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8" released by "delete_volume" :: held 0.640s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Created reservations ['97ae2884-5a27-4682-a3d1-e4fe94dd35d5', '955634f3-8dd0-4416-a92f-25cac28d1572', '0c943427-9ba7-470c-a977-9447d2545367', '6d0f6876-9c23-4ad4-a229-7fe2b2ff0d38'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:36 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:00:36 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:37 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.253s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:37 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:00:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Deleted volume successfully. Nov 05 04:00:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e39e206b-aa56-4dd2-9a76-923412b05cc4 tempest-TestServerVolumeAttachmentScenario-1665606173 None] Lock "cinder-b5fbe23f-59e1-4e10-8fc1-eeb7d784ecb8-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:00:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=24,cinder:UPDATE=18,cinder:INSERT=5 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Flow 'volume_create_manager' (a8748cd5-a6ab-4fbd-a4a2-2af97939d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3e6bd7-ce77-4efb-9e24-36b661826674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3e6bd7-ce77-4efb-9e24-36b661826674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-106542285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765e64cc-2df2-4a0d-840f-2cb73819b173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faa9b52d7af48f197571b132e04fcd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:09Z,use_quota=True,user_id='120b8a87c12a48d58bb9f272a3f3c0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83080f71-3c56-49a6-99f5-154561b372e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83080f71-3c56-49a6-99f5-154561b372e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb2cbdd-8cde-4f25-a85f-14cc6e1cf26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb2cbdd-8cde-4f25-a85f-14cc6e1cf26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '765e64cc-2df2-4a0d-840f-2cb73819b173', 'volume_name': 'volume-765e64cc-2df2-4a0d-840f-2cb73819b173', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8042933d-fb7f-4011-9105-dc25cf59f6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8042933d-fb7f-4011-9105-dc25cf59f6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aef501-5433-4516-ad33-4d341186b329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:09 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Volume 765e64cc-2df2-4a0d-840f-2cb73819b173: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-765e64cc-2df2-4a0d-840f-2cb73819b173', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 04:01:09 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Trying to clone 765e64cc-2df2-4a0d-840f-2cb73819b173 from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 04:01:10 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Image download 20.69 MB at 20.69 MB/s Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d87ef9d-60e7-4d5f-ad63-a9f302cd9e31]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:10 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD Nov 05 04:01:10 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:10 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 is fetched for user 120b8a87c12a48d58bb9f272a3f3c0d1. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[416cef10-d99f-424b-ae06-3ca71ce70437]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:10 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD Nov 05 04:01:10 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:10 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-106542285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765e64cc-2df2-4a0d-840f-2cb73819b173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faa9b52d7af48f197571b132e04fcd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:09Z,use_quota=True,user_id='120b8a87c12a48d58bb9f272a3f3c0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Creating volume 765e64cc-2df2-4a0d-840f-2cb73819b173 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:10 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:01:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:10 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 1073741824 Nov 05 04:01:10 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:11 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 1073741824" returned: 0 in 0.399s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:11 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 Nov 05 04:01:11 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:11 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173" returned: 0 in 0.242s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Attempting download of f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume 765e64cc-2df2-4a0d-840f-2cb73819b173. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d5392-6c8a-40a9-86ec-1b2373c7d9b6]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_z5odx_57 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:11 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_z5odx_57 Nov 05 04:01:11 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:11 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_z5odx_57" returned: 0 in 0.311s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_z5odx_57 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:12 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_z5odx_57 Nov 05 04:01:12 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:12 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_z5odx_57" returned: 1 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f813bdfc-9ad7-4949-b238-678b8d2b8f65_z5odx_57' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:01:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6184d7-16f2-4849-b009-c63c8b08b6ff]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:12 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD Nov 05 04:01:12 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:12 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:12 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] f813bdfc-9ad7-4949-b238-678b8d2b8f65 was qcow2, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 04:01:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:12 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 Nov 05 04:01:12 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:14 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173" returned: 0 in 1.700s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f813bdfc-9ad7-4949-b238-678b8d2b8f65_82gqgsundevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:01:14 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Converted 112.00 MB image at 65.83 MB/s Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:14 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 1G Nov 05 04:01:14 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:14 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 1G" returned: 0 in 0.303s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Downloaded image f813bdfc-9ad7-4949-b238-678b8d2b8f65 ((None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}])) to volume 765e64cc-2df2-4a0d-840f-2cb73819b173 successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Temporary image f813bdfc-9ad7-4949-b238-678b8d2b8f65 for user 120b8a87c12a48d58bb9f272a3f3c0d1 is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Marking volume 765e64cc-2df2-4a0d-840f-2cb73819b173 as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Copying metadata from image f813bdfc-9ad7-4949-b238-678b8d2b8f65 to 765e64cc-2df2-4a0d-840f-2cb73819b173. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Creating volume glance metadata for volume 765e64cc-2df2-4a0d-840f-2cb73819b173 backed by image f813bdfc-9ad7-4949-b238-678b8d2b8f65 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aef501-5433-4516-ad33-4d341186b329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765e64cc-2df2-4a0d-840f-2cb73819b173', 'volume_size': 1, 'image_id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '23e73870a3eb4bc58a1f28b1f66ab81a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f813bdfc-9ad7-4949-b238-678b8d2b8f65', 'created_at': datetime.datetime(2026, 11, 5, 2, 36, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 36, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f813bdfc-9ad7-4949-b238-678b8d2b8f65/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb80824d-396b-460b-ac04-320035deaf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Volume volume-765e64cc-2df2-4a0d-840f-2cb73819b173 (765e64cc-2df2-4a0d-840f-2cb73819b173): created successfully Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb80824d-396b-460b-ac04-320035deaf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Flow 'volume_create_manager' (a8748cd5-a6ab-4fbd-a4a2-2af97939d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0b2ffb8a-3054-4f37-b20e-39d70637ac62 tempest-TestShelveInstance-743054672 None] Created volume successfully. Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:15 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:01:15 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:15 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.255s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:01:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:01:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-e38b7b4b-acf2-40f5-bc34-7511554c3996 req-edc580ca-e249-4963-add9-e2bbbf451f35 tempest-TestShelveInstance-743054672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-e38b7b4b-acf2-40f5-bc34-7511554c3996 req-edc580ca-e249-4963-add9-e2bbbf451f35 tempest-TestShelveInstance-743054672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-e38b7b4b-acf2-40f5-bc34-7511554c3996 req-edc580ca-e249-4963-add9-e2bbbf451f35 tempest-TestShelveInstance-743054672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-e38b7b4b-acf2-40f5-bc34-7511554c3996 req-edc580ca-e249-4963-add9-e2bbbf451f35 tempest-TestShelveInstance-743054672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-765e64cc-2df2-4a0d-840f-2cb73819b173', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a37eee31-1569-4a7d-8161-21bf0814520c', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 04:01:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-e38b7b4b-acf2-40f5-bc34-7511554c3996 req-edc580ca-e249-4963-add9-e2bbbf451f35 tempest-TestShelveInstance-743054672 None] attachment_update completed successfully. Nov 05 04:01:27 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4,cinder:INSERT=4 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:01:27 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=11,cinder:INSERT=10,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:01:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-4c06f5c2-ad55-45b7-8cd2-d57bc8d036e1 req-ce73ebe7-083d-4dbe-bfc8-aea668d05ed6 tempest-TestShelveInstance-743054672 None] Terminate volume connection completed successfully. Nov 05 04:01:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-4c06f5c2-ad55-45b7-8cd2-d57bc8d036e1 req-ce73ebe7-083d-4dbe-bfc8-aea668d05ed6 tempest-TestShelveInstance-743054672 None] Deleting attachment a37eee31-1569-4a7d-8161-21bf0814520c. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 04:01:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1da5ba38-c1b5-41d8-957b-b56fe521c9e4 req-aa3c7ed6-9b61-4308-9b08-7ddb587aa15a tempest-TestShelveInstance-743054672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1da5ba38-c1b5-41d8-957b-b56fe521c9e4 req-aa3c7ed6-9b61-4308-9b08-7ddb587aa15a tempest-TestShelveInstance-743054672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-1da5ba38-c1b5-41d8-957b-b56fe521c9e4 req-aa3c7ed6-9b61-4308-9b08-7ddb587aa15a tempest-TestShelveInstance-743054672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-1da5ba38-c1b5-41d8-957b-b56fe521c9e4 req-aa3c7ed6-9b61-4308-9b08-7ddb587aa15a tempest-TestShelveInstance-743054672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-765e64cc-2df2-4a0d-840f-2cb73819b173', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5318f40f-129c-4947-9459-0ada853fcc58', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 04:01:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-1da5ba38-c1b5-41d8-957b-b56fe521c9e4 req-aa3c7ed6-9b61-4308-9b08-7ddb587aa15a tempest-TestShelveInstance-743054672 None] attachment_update completed successfully. Nov 05 04:02:02 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=8 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:02:02 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:15 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:02:15 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:15 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.254s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:02:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:02:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-5a508d3a-c5cd-491e-b687-2f06395d8026 tempest-TestShelveInstance-743054672 None] Terminate volume connection completed successfully. Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-5a508d3a-c5cd-491e-b687-2f06395d8026 tempest-TestShelveInstance-743054672 None] Deleting attachment 5318f40f-129c-4947-9459-0ada853fcc58. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Acquiring lock "cinder-765e64cc-2df2-4a0d-840f-2cb73819b173-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Lock "cinder-765e64cc-2df2-4a0d-840f-2cb73819b173-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Acquiring lock "cinder-quobyte-765e64cc-2df2-4a0d-840f-2cb73819b173" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Lock "cinder-quobyte-765e64cc-2df2-4a0d-840f-2cb73819b173" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e166ceaf-4eb9-49bb-8769-55632895fc49]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:37 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 Nov 05 04:02:37 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:37 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173" returned: 0 in 0.411s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:38 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173 Nov 05 04:02:38 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:38 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-765e64cc-2df2-4a0d-840f-2cb73819b173" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Lock "cinder-quobyte-765e64cc-2df2-4a0d-840f-2cb73819b173" released by "delete_volume" :: held 0.751s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG cinder.quota [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Created reservations ['999f4046-996b-468a-bc7f-8e8b0d52beb5', 'fb780de9-4b3a-4b37-aac1-0ed8407615ed', '196feaac-665c-48e9-abcc-9b78ef685f8b', 'e1f6787b-5411-4148-b940-5902e70e59ca'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:38 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:02:38 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:38 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.344s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG cinder.manager [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:38 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Deleted volume successfully. Nov 05 04:02:38 devstack cinder-volume[87111]: DEBUG cinder.coordination [req-f903276a-8c8e-4c83-beda-70c9449ba71a req-55a1ce26-b5f5-492f-98a4-0a9d5cb8abe6 tempest-TestShelveInstance-743054672 None] Lock "cinder-765e64cc-2df2-4a0d-840f-2cb73819b173-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:48 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:02:51 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:15 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:03:15 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:15 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.261s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:03:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Flow 'volume_create_manager' (90c0e27c-d4ef-49d7-9c12-68cd187d374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748eec28-464e-46a5-b6f2-5db60732f5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748eec28-464e-46a5-b6f2-5db60732f5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-943051368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8731b311-1ceb-41fd-8efe-64de7033f741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad4a39241eac431c93a48c5b1c572267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:16Z,use_quota=True,user_id='542aef761f864b5dbcb01820770c3527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9d449d-de08-490e-ae1b-522c26040546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9d449d-de08-490e-ae1b-522c26040546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7438d4b5-b2af-4489-ac3a-8908fdfdc752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7438d4b5-b2af-4489-ac3a-8908fdfdc752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8731b311-1ceb-41fd-8efe-64de7033f741', 'volume_name': 'volume-8731b311-1ceb-41fd-8efe-64de7033f741', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122f7275-d9bb-4ae6-96f2-340ea5ae2c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122f7275-d9bb-4ae6-96f2-340ea5ae2c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc84be8-071e-48ea-a543-6d658a0d0aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:16 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Volume 8731b311-1ceb-41fd-8efe-64de7033f741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8731b311-1ceb-41fd-8efe-64de7033f741', 'volume_size': 1} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-943051368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8731b311-1ceb-41fd-8efe-64de7033f741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad4a39241eac431c93a48c5b1c572267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:16Z,use_quota=True,user_id='542aef761f864b5dbcb01820770c3527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Creating volume 8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:16 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:16 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 1073741824 Nov 05 04:03:16 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:16 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 1073741824" returned: 0 in 0.479s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:16 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 Nov 05 04:03:16 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:17 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741" returned: 0 in 0.269s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc84be8-071e-48ea-a543-6d658a0d0aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8731b311-1ceb-41fd-8efe-64de7033f741', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a61e480-3d2e-46d6-959a-fb5e3d84ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:17 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Volume volume-8731b311-1ceb-41fd-8efe-64de7033f741 (8731b311-1ceb-41fd-8efe-64de7033f741): created successfully Nov 05 04:03:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a61e480-3d2e-46d6-959a-fb5e3d84ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Flow 'volume_create_manager' (90c0e27c-d4ef-49d7-9c12-68cd187d374a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b6830b83-cd69-473c-a5d0-ae452b0cfe12 tempest-TestStampPattern-63372412 None] Created volume successfully. Nov 05 04:03:27 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:03:27 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:03:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-40536c9a-71a5-49de-b97e-05420946fba2 req-e19a33fc-37b9-4ddb-abb3-c18d520e1461 tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-40536c9a-71a5-49de-b97e-05420946fba2 req-e19a33fc-37b9-4ddb-abb3-c18d520e1461 tempest-TestStampPattern-63372412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-40536c9a-71a5-49de-b97e-05420946fba2 req-e19a33fc-37b9-4ddb-abb3-c18d520e1461 tempest-TestStampPattern-63372412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-40536c9a-71a5-49de-b97e-05420946fba2 req-e19a33fc-37b9-4ddb-abb3-c18d520e1461 tempest-TestStampPattern-63372412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-8731b311-1ceb-41fd-8efe-64de7033f741', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e570c97-caa7-4a0e-9414-7031bd69bbb9', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 04:03:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-40536c9a-71a5-49de-b97e-05420946fba2 req-e19a33fc-37b9-4ddb-abb3-c18d520e1461 tempest-TestStampPattern-63372412 None] attachment_update completed successfully. Nov 05 04:03:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-700e0b86-caea-4242-986d-a9c9423dbfda req-fc05d10e-5ee1-4800-a7a8-bf1a7e8e565e tempest-TestStampPattern-63372412 None] Terminate volume connection completed successfully. Nov 05 04:03:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-700e0b86-caea-4242-986d-a9c9423dbfda req-fc05d10e-5ee1-4800-a7a8-bf1a7e8e565e tempest-TestStampPattern-63372412 None] Deleting attachment 0e570c97-caa7-4a0e-9414-7031bd69bbb9. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 04:03:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Creating offline snapshot 315eea5e-1543-492a-b5dc-1109496eb264 of volume 8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:52 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4e87d5-5508-42b8-9fbf-2609e9dc7476]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:52 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 Nov 05 04:03:52 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:53 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741" returned: 0 in 0.340s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:53 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 1G Nov 05 04:03:53 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:53 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 1G" returned: 0 in 0.390s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8731b311-1ceb-41fd-8efe-64de7033f741 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:53 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8731b311-1ceb-41fd-8efe-64de7033f741 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 Nov 05 04:03:53 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:53 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8731b311-1ceb-41fd-8efe-64de7033f741 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264" returned: 0 in 0.302s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:53 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 is being set with open permissions: ugo+rw Nov 05 04:03:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:53 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 Nov 05 04:03:53 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:54 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264" returned: 0 in 0.253s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:54 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.info Nov 05 04:03:54 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:54 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.info" returned: 0 in 0.252s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:54 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.info is being set with open permissions: ugo+rw Nov 05 04:03:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:54 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.info Nov 05 04:03:54 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:54 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.info" returned: 0 in 0.243s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:54 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-102a6ff2-acfd-4b60-93af-47d1cb54549e tempest-TestStampPattern-63372412 None] Create snapshot completed successfully Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Flow 'volume_create_manager' (744e64ee-764f-4071-a693-7a6c527bc404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b22ed-3838-4c2c-a24f-e73209f03daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b22ed-3838-4c2c-a24f-e73209f03daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-321250628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a244d13-7bcb-454f-a1e8-d60461c2a73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad4a39241eac431c93a48c5b1c572267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=315eea5e-1543-492a-b5dc-1109496eb264,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:01Z,use_quota=True,user_id='542aef761f864b5dbcb01820770c3527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fab28d-c140-4134-a447-59cbf1f75339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fab28d-c140-4134-a447-59cbf1f75339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a49604-50da-4c22-b402-e571b37eb3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a49604-50da-4c22-b402-e571b37eb3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a244d13-7bcb-454f-a1e8-d60461c2a73b', 'volume_name': 'volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b', 'volume_size': 1, 'snapshot_id': '315eea5e-1543-492a-b5dc-1109496eb264'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371328e9-7188-4e99-a485-c96474fe0596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371328e9-7188-4e99-a485-c96474fe0596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fa967e-e84d-4eff-b28b-2ff0b2d81b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:01 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Volume 8a244d13-7bcb-454f-a1e8-d60461c2a73b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b', 'volume_size': 1, 'snapshot_id': '315eea5e-1543-492a-b5dc-1109496eb264'} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-quobyte-315eea5e-1543-492a-b5dc-1109496eb264-8a244d13-7bcb-454f-a1e8-d60461c2a73b" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-315eea5e-1543-492a-b5dc-1109496eb264-8a244d13-7bcb-454f-a1e8-d60461c2a73b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Creating volume 8a244d13-7bcb-454f-a1e8-d60461c2a73b from snapshot 315eea5e-1543-492a-b5dc-1109496eb264 {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-quobyte-8a244d13-7bcb-454f-a1e8-d60461c2a73b" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-8a244d13-7bcb-454f-a1e8-d60461c2a73b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] snapshot: 315eea5e-1543-492a-b5dc-1109496eb264, volume: 8a244d13-7bcb-454f-a1e8-d60461c2a73b, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2caaeb-b11a-4ee2-bb75-6a46f00f1608]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:01 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 Nov 05 04:04:01 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:02 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264" returned: 0 in 0.383s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8731b311-1ceb-41fd-8efe-64de7033f741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[374166aa-fd1f-4dee-ba64-9023023ac93c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:02 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 Nov 05 04:04:02 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:02 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741" returned: 0 in 0.399s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 04:04:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:02 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b Nov 05 04:04:02 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:11 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b" returned: 0 in 8.921s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741, size 1024.00 MB, duration 8.92 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:04:11 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Converted 1024.00 MB image at 114.77 MB/s Nov 05 04:04:11 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b is being set with open permissions: ugo+rw Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:04:11 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b Nov 05 04:04:11 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=19,cinder:UPDATE=3 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:04:11 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b" returned: 0 in 0.279s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-8a244d13-7bcb-454f-a1e8-d60461c2a73b" released by "_copy_volume_from_snapshot" :: held 10.091s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-315eea5e-1543-492a-b5dc-1109496eb264-8a244d13-7bcb-454f-a1e8-d60461c2a73b" released by "_create_volume_from_snapshot" :: held 10.165s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.183s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fa967e-e84d-4eff-b28b-2ff0b2d81b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b', 'volume_size': 1, 'snapshot_id': '315eea5e-1543-492a-b5dc-1109496eb264'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55120796-dc52-4996-9c2d-cebb06a40bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:11 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Volume volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b (8a244d13-7bcb-454f-a1e8-d60461c2a73b): created successfully Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55120796-dc52-4996-9c2d-cebb06a40bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Flow 'volume_create_manager' (744e64ee-764f-4071-a693-7a6c527bc404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:04:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5b93467c-c51e-4835-aaf0-8cc61f0591c5 tempest-TestStampPattern-63372412 None] Created volume successfully. Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:15 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:04:15 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:15 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:04:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:04:21 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:04:21 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:04:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ede5b061-6c4c-4abc-85f7-3d1ce30efb92 req-1473eea3-df54-4ae8-98c8-097986bafd2d tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ede5b061-6c4c-4abc-85f7-3d1ce30efb92 req-1473eea3-df54-4ae8-98c8-097986bafd2d tempest-TestStampPattern-63372412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [req-ede5b061-6c4c-4abc-85f7-3d1ce30efb92 req-1473eea3-df54-4ae8-98c8-097986bafd2d tempest-TestStampPattern-63372412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-ede5b061-6c4c-4abc-85f7-3d1ce30efb92 req-1473eea3-df54-4ae8-98c8-097986bafd2d tempest-TestStampPattern-63372412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4', 'name': 'volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '396132ab-e8e9-4e79-97d3-bb6f750d440d', 'enforce_multipath': True} {{(pid=87111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 04:04:38 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-ede5b061-6c4c-4abc-85f7-3d1ce30efb92 req-1473eea3-df54-4ae8-98c8-097986bafd2d tempest-TestStampPattern-63372412 None] attachment_update completed successfully. Nov 05 04:04:41 devstack cinder-volume[87111]: INFO cinder.volume.manager [req-f8041816-1715-4302-903f-d3df59d112aa req-0b63db57-c9a1-4da7-9198-1fdf2adef456 tempest-TestStampPattern-63372412 None] Terminate volume connection completed successfully. Nov 05 04:04:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [req-f8041816-1715-4302-903f-d3df59d112aa req-0b63db57-c9a1-4da7-9198-1fdf2adef456 tempest-TestStampPattern-63372412 None] Deleting attachment 396132ab-e8e9-4e79-97d3-bb6f750d440d. {{(pid=87111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 04:04:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-8a244d13-7bcb-454f-a1e8-d60461c2a73b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Lock "cinder-8a244d13-7bcb-454f-a1e8-d60461c2a73b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-quobyte-8a244d13-7bcb-454f-a1e8-d60461c2a73b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-8a244d13-7bcb-454f-a1e8-d60461c2a73b" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:45 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a41c55d-60d1-4e4d-a0f8-acbc7c259f9f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:45 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b Nov 05 04:04:45 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:46 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b" returned: 0 in 0.350s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:46 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b Nov 05 04:04:46 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:46 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a244d13-7bcb-454f-a1e8-d60461c2a73b" returned: 0 in 0.254s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-8a244d13-7bcb-454f-a1e8-d60461c2a73b" released by "delete_volume" :: held 0.644s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Created reservations ['20d2b9ca-5a3a-4d9b-8bf3-7a1a2db7ecf2', 'c1c1386f-e734-4948-8184-c83a50ac0818', '77faecbb-f295-4435-97e6-8e583382fb89', '443943d0-8621-4c8d-ab9d-9417688ff00c'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:46 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:04:46 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:46 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:04:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Deleted volume successfully. Nov 05 04:04:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fe2fe58f-85a7-4bf5-ae18-cfd54d9b4e7d tempest-TestStampPattern-63372412 None] Lock "cinder-8a244d13-7bcb-454f-a1e8-d60461c2a73b-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-315eea5e-1543-492a-b5dc-1109496eb264-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Lock "cinder-315eea5e-1543-492a-b5dc-1109496eb264-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-quobyte-8731b311-1ceb-41fd-8efe-64de7033f741" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-8731b311-1ceb-41fd-8efe-64de7033f741" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-quobyte-315eea5e-1543-492a-b5dc-1109496eb264" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-315eea5e-1543-492a-b5dc-1109496eb264" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Deleting offline snapshot 315eea5e-1543-492a-b5dc-1109496eb264 of volume 8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] snapshot_file for this snap is: volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d4acf0-a244-48db-a640-dfa0e684a945]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:47 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 Nov 05 04:04:47 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:47 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264" returned: 0 in 0.352s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8731b311-1ceb-41fd-8efe-64de7033f741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17cb85-0666-4d8a-9ffa-399bc28d6a35]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:47 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 Nov 05 04:04:47 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:48 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741" returned: 0 in 0.509s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:48 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 Nov 05 04:04:48 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:48 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264" returned: 0 in 0.311s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:48 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264 Nov 05 04:04:48 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:48 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741.315eea5e-1543-492a-b5dc-1109496eb264" returned: 0 in 0.254s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-315eea5e-1543-492a-b5dc-1109496eb264" released by "_delete_snapshot" :: held 1.524s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-8731b311-1ceb-41fd-8efe-64de7033f741" released by "delete_snapshot" :: held 1.547s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Created reservations ['4360659b-5b9e-4c6d-a632-de39313669ba', '26b99d75-c424-49ea-816b-de4b0b5a3df4', '869a852c-679f-4e66-aed4-cf10589837d0', '760b8e02-597b-4389-b0c4-df026f96a166'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:04:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Delete snapshot completed successfully. Nov 05 04:04:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-8fd865bb-ea10-4949-af93-9a33b0c57a74 tempest-TestStampPattern-63372412 None] Lock "cinder-315eea5e-1543-492a-b5dc-1109496eb264-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-8731b311-1ceb-41fd-8efe-64de7033f741-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Lock "cinder-8731b311-1ceb-41fd-8efe-64de7033f741-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Acquiring lock "cinder-quobyte-8731b311-1ceb-41fd-8efe-64de7033f741" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-8731b311-1ceb-41fd-8efe-64de7033f741" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:52 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4614be0-ae24-4917-8c8d-68dcd487e673]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:52 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 Nov 05 04:04:52 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:53 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741" returned: 0 in 0.347s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:53 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741 Nov 05 04:04:53 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:53 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8731b311-1ceb-41fd-8efe-64de7033f741" returned: 0 in 0.231s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Lock "cinder-quobyte-8731b311-1ceb-41fd-8efe-64de7033f741" released by "delete_volume" :: held 0.631s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Created reservations ['61919371-f9f2-410b-89fc-c8f6e8621788', '54191834-0416-478d-99c5-41269e88f755', '69e6fe30-4e9c-496e-8f91-a907ed5d4175', '41022129-2c6a-4a1d-bcfa-49e4a400e1f5'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:53 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:04:53 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:53 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.240s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:04:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Deleted volume successfully. Nov 05 04:04:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-116fa536-f382-4cfa-bb99-7e3d31572778 tempest-TestStampPattern-63372412 None] Lock "cinder-8731b311-1ceb-41fd-8efe-64de7033f741-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:03 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=8 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:05:03 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Flow 'volume_create_manager' (344f2b6c-ad15-43ff-9e10-ae4d03498966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62738e4-42fb-4cec-8c5b-69dd429130ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62738e4-42fb-4cec-8c5b-69dd429130ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0db5ad-55a2-471c-b780-315c6fa46629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbc1068937740e0ad94f017605b6ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:07Z,use_quota=True,user_id='6e7474553bbb408490db8fd25bfa75bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0302a844-5eb4-43d2-8290-2a07f62e86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0302a844-5eb4-43d2-8290-2a07f62e86bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd907ead-413a-43dc-bb18-97da1541978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd907ead-413a-43dc-bb18-97da1541978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a0db5ad-55a2-471c-b780-315c6fa46629', 'volume_name': 'volume-4a0db5ad-55a2-471c-b780-315c6fa46629', 'volume_size': 1, 'image_id': '86dc6e18-a3d5-434a-982c-7ae4199a556e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86dc6e18-a3d5-434a-982c-7ae4199a556e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e35668f8ed6081ecff3ad08351e190b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2cbc1068937740e0ad94f017605b6ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fbc7500f952e5c0e3457bc6323f6bfd7fb9ad8b99d57b41c8ac8adbf88657aa3ee932293348275304a3523a1088058e3b670309a8de3e7d66e21a5c7dbe1d79', 'id': '86dc6e18-a3d5-434a-982c-7ae4199a556e', 'created_at': datetime.datetime(2026, 11, 5, 3, 5, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 5, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86dc6e18-a3d5-434a-982c-7ae4199a556e/file', 'properties': {}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8d114e-511c-4238-96ad-d8dfdab9ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8d114e-511c-4238-96ad-d8dfdab9ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39790155-8eff-4f34-a3ea-495a757713b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:07 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Volume 4a0db5ad-55a2-471c-b780-315c6fa46629: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a0db5ad-55a2-471c-b780-315c6fa46629', 'volume_size': 1, 'image_id': '86dc6e18-a3d5-434a-982c-7ae4199a556e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86dc6e18-a3d5-434a-982c-7ae4199a556e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e35668f8ed6081ecff3ad08351e190b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2cbc1068937740e0ad94f017605b6ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fbc7500f952e5c0e3457bc6323f6bfd7fb9ad8b99d57b41c8ac8adbf88657aa3ee932293348275304a3523a1088058e3b670309a8de3e7d66e21a5c7dbe1d79', 'id': '86dc6e18-a3d5-434a-982c-7ae4199a556e', 'created_at': datetime.datetime(2026, 11, 5, 3, 5, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 5, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86dc6e18-a3d5-434a-982c-7ae4199a556e/file', 'properties': {}}, 'image_service': } Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Trying to clone 4a0db5ad-55a2-471c-b780-315c6fa46629 from image 86dc6e18-a3d5-434a-982c-7ae4199a556e at location (None, [{'url': 'file:///opt/stack/data/glance/images/86dc6e18-a3d5-434a-982c-7ae4199a556e', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 04:05:07 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Image download 0.00 MB at 0.00 MB/s Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[778a22af-97e2-4c39-aa2e-e7a4a0a3f289]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:07 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD Nov 05 04:05:07 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:08 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:08 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD Nov 05 04:05:08 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:08 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Temporary image 86dc6e18-a3d5-434a-982c-7ae4199a556e is fetched for user 6e7474553bbb408490db8fd25bfa75bb. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ae6eef-0fbf-4b6a-959e-6f22bbb9b6b0]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:08 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD Nov 05 04:05:08 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:08 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:08 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD Nov 05 04:05:08 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:09 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD" returned: 1 in 0.305s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0db5ad-55a2-471c-b780-315c6fa46629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbc1068937740e0ad94f017605b6ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:07Z,use_quota=True,user_id='6e7474553bbb408490db8fd25bfa75bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Creating volume 4a0db5ad-55a2-471c-b780-315c6fa46629 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:09 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:09 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 1073741824 Nov 05 04:05:09 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:09 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 1073741824" returned: 0 in 0.420s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:09 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 Nov 05 04:05:09 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:09 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629" returned: 0 in 0.236s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Attempting download of 86dc6e18-a3d5-434a-982c-7ae4199a556e ((None, [{'url': 'file:///opt/stack/data/glance/images/86dc6e18-a3d5-434a-982c-7ae4199a556e', 'metadata': {}}])) to volume 4a0db5ad-55a2-471c-b780-315c6fa46629. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[768c9729-72d1-4cd2-a816-b5fc60898157]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86dc6e18-a3d5-434a-982c-7ae4199a556e_6tj9cv_f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:09 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86dc6e18-a3d5-434a-982c-7ae4199a556e_6tj9cv_f Nov 05 04:05:09 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:10 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86dc6e18-a3d5-434a-982c-7ae4199a556e_6tj9cv_f" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86dc6e18-a3d5-434a-982c-7ae4199a556e_6tj9cv_f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:10 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86dc6e18-a3d5-434a-982c-7ae4199a556e_6tj9cv_f Nov 05 04:05:10 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:10 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86dc6e18-a3d5-434a-982c-7ae4199a556e_6tj9cv_f" returned: 1 in 0.309s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86dc6e18-a3d5-434a-982c-7ae4199a556e_6tj9cv_f' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:05:10 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf71ef7d-d2c8-4ea9-8fc7-c32497c28fa6]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:10 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD Nov 05 04:05:10 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:10 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:10 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD Nov 05 04:05:10 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:11 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD" returned: 1 in 0.309s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] 86dc6e18-a3d5-434a-982c-7ae4199a556e was raw, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:11 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 Nov 05 04:05:11 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:11 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629" returned: 0 in 0.424s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86dc6e18-a3d5-434a-982c-7ae4199a556e_5p5cpwd_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:05:11 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:11 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 1G Nov 05 04:05:11 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:11 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 1G" returned: 0 in 0.296s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Downloaded image 86dc6e18-a3d5-434a-982c-7ae4199a556e ((None, [{'url': 'file:///opt/stack/data/glance/images/86dc6e18-a3d5-434a-982c-7ae4199a556e', 'metadata': {}}])) to volume 4a0db5ad-55a2-471c-b780-315c6fa46629 successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Temporary image 86dc6e18-a3d5-434a-982c-7ae4199a556e for user 6e7474553bbb408490db8fd25bfa75bb is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Marking volume 4a0db5ad-55a2-471c-b780-315c6fa46629 as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Copying metadata from image 86dc6e18-a3d5-434a-982c-7ae4199a556e to 4a0db5ad-55a2-471c-b780-315c6fa46629. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Creating volume glance metadata for volume 4a0db5ad-55a2-471c-b780-315c6fa46629 backed by image 86dc6e18-a3d5-434a-982c-7ae4199a556e with: {'image_id': '86dc6e18-a3d5-434a-982c-7ae4199a556e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e35668f8ed6081ecff3ad08351e190b7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39790155-8eff-4f34-a3ea-495a757713b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0db5ad-55a2-471c-b780-315c6fa46629', 'volume_size': 1, 'image_id': '86dc6e18-a3d5-434a-982c-7ae4199a556e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86dc6e18-a3d5-434a-982c-7ae4199a556e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e35668f8ed6081ecff3ad08351e190b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2cbc1068937740e0ad94f017605b6ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fbc7500f952e5c0e3457bc6323f6bfd7fb9ad8b99d57b41c8ac8adbf88657aa3ee932293348275304a3523a1088058e3b670309a8de3e7d66e21a5c7dbe1d79', 'id': '86dc6e18-a3d5-434a-982c-7ae4199a556e', 'created_at': datetime.datetime(2026, 11, 5, 3, 5, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 5, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86dc6e18-a3d5-434a-982c-7ae4199a556e/file', 'properties': {}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6543cd3e-416b-4d3a-a5aa-d93c86355698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:11 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Volume volume-4a0db5ad-55a2-471c-b780-315c6fa46629 (4a0db5ad-55a2-471c-b780-315c6fa46629): created successfully Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6543cd3e-416b-4d3a-a5aa-d93c86355698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:11 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Flow 'volume_create_manager' (344f2b6c-ad15-43ff-9e10-ae4d03498966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:11 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7e898c1d-cc8b-4996-9027-65426d86b19a tempest-VolumeImageDependencyTests-1883019622 None] Created volume successfully. Nov 05 04:05:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Acquiring lock "cinder-4a0db5ad-55a2-471c-b780-315c6fa46629-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Lock "cinder-4a0db5ad-55a2-471c-b780-315c6fa46629-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Acquiring lock "cinder-quobyte-4a0db5ad-55a2-471c-b780-315c6fa46629" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Lock "cinder-quobyte-4a0db5ad-55a2-471c-b780-315c6fa46629" acquired by "delete_volume" :: waited 0.012s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a222ac-24e1-4e52-8f15-fbe9b090dd92]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:12 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 Nov 05 04:05:12 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:13 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629" returned: 0 in 0.365s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:13 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629 Nov 05 04:05:13 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:13 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4a0db5ad-55a2-471c-b780-315c6fa46629" returned: 0 in 0.243s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Lock "cinder-quobyte-4a0db5ad-55a2-471c-b780-315c6fa46629" released by "delete_volume" :: held 0.645s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Created reservations ['cbb0fc6d-e33f-464a-b3d3-1fae9aa9fedd', '2a7ac05b-e077-4fbb-a9d3-be465bb05a68', 'ab2e8407-ee29-4b23-ac0a-3e71a42a60e6', '708813b2-919d-43ae-814d-286bfc6ab3f5'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:13 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:13 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:13 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.240s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Deleted volume successfully. Nov 05 04:05:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2566f5b8-4326-46c4-8ac4-af1c1e0bc3f3 tempest-VolumeImageDependencyTests-1883019622 None] Lock "cinder-4a0db5ad-55a2-471c-b780-315c6fa46629-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:15 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:15 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:15 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.249s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:05:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Flow 'volume_create_manager' (f70a36a0-5f22-48d9-879a-57163a624891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2d09bf-7b27-4ea4-b44e-f8ecb8adf8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2d09bf-7b27-4ea4-b44e-f8ecb8adf8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579867112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ff8baf-3039-461c-a37e-9b74af11d7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e958825c9b747f8ae9900108fcd0009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:17Z,use_quota=True,user_id='86ef31c994634528b147282e86fa767c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30b1bab-e0b4-4b95-9e3e-c7f4b457571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30b1bab-e0b4-4b95-9e3e-c7f4b457571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c303942-009a-4f76-a029-a53364525015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c303942-009a-4f76-a029-a53364525015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ff8baf-3039-461c-a37e-9b74af11d7ff', 'volume_name': 'volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0305c2c-2e90-4329-aaad-4eab925e9911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0305c2c-2e90-4329-aaad-4eab925e9911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d0e1bb-dc1d-4424-b307-4679fb5c95da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:17 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Volume c7ff8baf-3039-461c-a37e-9b74af11d7ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff', 'volume_size': 1} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579867112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ff8baf-3039-461c-a37e-9b74af11d7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e958825c9b747f8ae9900108fcd0009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:17Z,use_quota=True,user_id='86ef31c994634528b147282e86fa767c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Creating volume c7ff8baf-3039-461c-a37e-9b74af11d7ff {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:17 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:17 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff 1073741824 Nov 05 04:05:17 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:17 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff 1073741824" returned: 0 in 0.404s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:17 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff Nov 05 04:05:17 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:18 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff" returned: 0 in 0.236s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d0e1bb-dc1d-4424-b307-4679fb5c95da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6daab73-2edc-4ba6-befc-ad706dca5ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:18 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Volume volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff (c7ff8baf-3039-461c-a37e-9b74af11d7ff): created successfully Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6daab73-2edc-4ba6-befc-ad706dca5ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Flow 'volume_create_manager' (f70a36a0-5f22-48d9-879a-57163a624891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9c8d529f-e972-4977-9a61-d7c659f524e3 tempest-ProjectReaderTests-94004275 None] Created volume successfully. Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Acquiring lock "cinder-c7ff8baf-3039-461c-a37e-9b74af11d7ff-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Lock "cinder-c7ff8baf-3039-461c-a37e-9b74af11d7ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Acquiring lock "cinder-quobyte-c7ff8baf-3039-461c-a37e-9b74af11d7ff" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Lock "cinder-quobyte-c7ff8baf-3039-461c-a37e-9b74af11d7ff" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[270ce719-c356-4949-b48b-c479ad405f41]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:18 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff Nov 05 04:05:18 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:18 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff" returned: 0 in 0.344s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:18 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff Nov 05 04:05:18 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:19 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c7ff8baf-3039-461c-a37e-9b74af11d7ff" returned: 0 in 0.252s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Lock "cinder-quobyte-c7ff8baf-3039-461c-a37e-9b74af11d7ff" released by "delete_volume" :: held 0.642s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Created reservations ['412a77dc-618b-475b-9925-80cb615abf31', '2d4152ef-f593-40a5-a439-9284df0e1733', 'f1555d03-dedc-4f1f-8f19-9861bcf62e2c', '28585a41-da04-4c20-8f94-1be4a997b96b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:19 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:19 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:19 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.240s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:19 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Deleted volume successfully. Nov 05 04:05:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c6790ef9-e196-41d7-b7df-8eab5bceb216 tempest-ProjectReaderTests-94004275 None] Lock "cinder-c7ff8baf-3039-461c-a37e-9b74af11d7ff-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Flow 'volume_create_manager' (531340dc-9c4a-4988-84a4-08d1cdeec93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4e93aa-93e2-4f84-a81e-544f9d01d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4e93aa-93e2-4f84-a81e-544f9d01d465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696726551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f56bbc-d940-4dd6-bd00-69aac0303ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e958825c9b747f8ae9900108fcd0009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:20Z,use_quota=True,user_id='86ef31c994634528b147282e86fa767c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68b4080-d5f3-4341-bcff-e9be64c4da75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68b4080-d5f3-4341-bcff-e9be64c4da75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fefc6b-78cf-43c3-9c86-19233ad031b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fefc6b-78cf-43c3-9c86-19233ad031b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f56bbc-d940-4dd6-bd00-69aac0303ae8', 'volume_name': 'volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a3ba8d-ab5b-4ec8-a914-76a376d350a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a3ba8d-ab5b-4ec8-a914-76a376d350a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a334784-a34f-458e-886f-d134097c398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Volume 42f56bbc-d940-4dd6-bd00-69aac0303ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8', 'volume_size': 1} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696726551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f56bbc-d940-4dd6-bd00-69aac0303ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e958825c9b747f8ae9900108fcd0009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:20Z,use_quota=True,user_id='86ef31c994634528b147282e86fa767c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Creating volume 42f56bbc-d940-4dd6-bd00-69aac0303ae8 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:20 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:20 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 1073741824 Nov 05 04:05:20 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:20 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 1073741824" returned: 0 in 0.403s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:20 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 Nov 05 04:05:20 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:20 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8" returned: 0 in 0.240s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a334784-a34f-458e-886f-d134097c398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa3f240-22d7-459a-8797-7b59752d28e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Volume volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 (42f56bbc-d940-4dd6-bd00-69aac0303ae8): created successfully Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa3f240-22d7-459a-8797-7b59752d28e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Flow 'volume_create_manager' (531340dc-9c4a-4988-84a4-08d1cdeec93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3a3a22de-a6e8-4bc0-a3ce-506b98903d3c tempest-ProjectReaderTests-94004275 None] Created volume successfully. Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Acquiring lock "cinder-42f56bbc-d940-4dd6-bd00-69aac0303ae8-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Lock "cinder-42f56bbc-d940-4dd6-bd00-69aac0303ae8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Acquiring lock "cinder-quobyte-42f56bbc-d940-4dd6-bd00-69aac0303ae8" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Lock "cinder-quobyte-42f56bbc-d940-4dd6-bd00-69aac0303ae8" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b98157-59dc-482c-b946-591d231495b3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:21 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 Nov 05 04:05:21 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:21 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8" returned: 0 in 0.365s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:21 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8 Nov 05 04:05:21 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:21 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-42f56bbc-d940-4dd6-bd00-69aac0303ae8" returned: 0 in 0.235s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Lock "cinder-quobyte-42f56bbc-d940-4dd6-bd00-69aac0303ae8" released by "delete_volume" :: held 0.637s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Created reservations ['154b1d79-b389-43a3-87db-b02f6d86f93c', 'ee237bdf-fc31-46ef-8fe7-368584e12632', 'b1543c96-cab0-471c-a0aa-9bbe71e00655', 'fa11a411-112b-455c-b846-4830ee3c5e26'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:22 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:22 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:22 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.232s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:22 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:22 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Deleted volume successfully. Nov 05 04:05:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bcec7dc-0ab2-453e-b3ea-a6c97929aa41 tempest-ProjectReaderTests-94004275 None] Lock "cinder-42f56bbc-d940-4dd6-bd00-69aac0303ae8-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:31 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=33,cinder:UPDATE=36,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:05:32 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=26,cinder:INSERT=12,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Flow 'volume_create_manager' (6790dbba-c07a-4270-aa27-e6643a5f7b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd362f4-4666-4548-b6f9-2b3313d45421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd362f4-4666-4548-b6f9-2b3313d45421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a954673c-51ec-40e7-8a82-82b310213a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a27b8171a94e7a808857bc0ca3bea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:39Z,use_quota=True,user_id='d5f258c702574cdab8c49160e44b0d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307c2fbf-5bf6-4f53-af34-c431f5e15a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307c2fbf-5bf6-4f53-af34-c431f5e15a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ca7353-03a0-4aca-b9b3-c4fcf355bc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ca7353-03a0-4aca-b9b3-c4fcf355bc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a954673c-51ec-40e7-8a82-82b310213a76', 'volume_name': 'volume-a954673c-51ec-40e7-8a82-82b310213a76', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c1498a-9c20-48b5-9721-375afa096104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c1498a-9c20-48b5-9721-375afa096104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7feed2-ecd6-4443-adcc-2350b394f4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Volume a954673c-51ec-40e7-8a82-82b310213a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a954673c-51ec-40e7-8a82-82b310213a76', 'volume_size': 1} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a954673c-51ec-40e7-8a82-82b310213a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a27b8171a94e7a808857bc0ca3bea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:39Z,use_quota=True,user_id='d5f258c702574cdab8c49160e44b0d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Creating volume a954673c-51ec-40e7-8a82-82b310213a76 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:39 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:39 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 1073741824 Nov 05 04:05:39 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (d290efd2-5ddb-4043-8c0f-0046ca4fb15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23715f62-ec5a-4d82-854f-0e58ae38dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23715f62-ec5a-4d82-854f-0e58ae38dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-572023288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f00d26-a9b4-40f8-a1ba-e547ccdf23ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:39Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875b812d-f57a-4b74-9bda-8c830c2b85da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875b812d-f57a-4b74-9bda-8c830c2b85da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670db467-17ac-4c81-a007-ef5bc23ed7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670db467-17ac-4c81-a007-ef5bc23ed7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f00d26-a9b4-40f8-a1ba-e547ccdf23ef', 'volume_name': 'volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f763351-4ec7-4556-b540-7fd24f12f649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f763351-4ec7-4556-b540-7fd24f12f649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2dc3ad-3d3d-43b4-a69d-5d51dbde37eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:39 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume 67f00d26-a9b4-40f8-a1ba-e547ccdf23ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef', 'volume_size': 1} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:39 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 1073741824" returned: 0 in 0.531s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:39 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 Nov 05 04:05:39 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:39 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (9117c4c2-f933-454b-8ad7-f44a3dfd6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6a3807-420a-4709-8c93-b418521001f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6a3807-420a-4709-8c93-b418521001f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1330981255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8740fd-36be-4cc7-9d93-93c4d9000c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:40Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113bb80c-5084-4f66-8eef-afa4dc779f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113bb80c-5084-4f66-8eef-afa4dc779f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94462b08-5178-4cbb-bde8-6512f3e437b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94462b08-5178-4cbb-bde8-6512f3e437b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8740fd-36be-4cc7-9d93-93c4d9000c7c', 'volume_name': 'volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedce3a3-f39b-452f-934a-8342f97335cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedce3a3-f39b-452f-934a-8342f97335cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6b9fed-13a2-49ba-aa58-3238ea515295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Volume 8a8740fd-36be-4cc7-9d93-93c4d9000c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c', 'volume_size': 1} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:40 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76" returned: 0 in 0.451s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-572023288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f00d26-a9b4-40f8-a1ba-e547ccdf23ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:39Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Creating volume 67f00d26-a9b4-40f8-a1ba-e547ccdf23ef {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:40 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7feed2-ecd6-4443-adcc-2350b394f4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a954673c-51ec-40e7-8a82-82b310213a76', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3eb716b-cf21-43b6-b324-5d58a0db28bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef 1073741824 Nov 05 04:05:40 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:40 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Volume volume-a954673c-51ec-40e7-8a82-82b310213a76 (a954673c-51ec-40e7-8a82-82b310213a76): created successfully Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3eb716b-cf21-43b6-b324-5d58a0db28bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Flow 'volume_create_manager' (6790dbba-c07a-4270-aa27-e6643a5f7b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (a0b11bea-324f-45d2-aa5f-8f8d05c7f2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c6ec98-d30a-4957-82b8-d8727adfa397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-084ecbe9-a88c-4494-b569-d7613e087126 tempest-CinderUnicodeTest-1845293149 None] Created volume successfully. Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c6ec98-d30a-4957-82b8-d8727adfa397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908872219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7092dab7-6bac-45b1-815c-753ba40b4dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:40Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafbdc52-f347-4a71-87a2-dd3660a3c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafbdc52-f347-4a71-87a2-dd3660a3c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aeb968b-6033-4f70-bfb4-c27388ce3991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aeb968b-6033-4f70-bfb4-c27388ce3991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7092dab7-6bac-45b1-815c-753ba40b4dfa', 'volume_name': 'volume-7092dab7-6bac-45b1-815c-753ba40b4dfa', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ef5022-1139-4b94-95bd-b99804374279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ef5022-1139-4b94-95bd-b99804374279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d00386-b61e-428b-b1c0-25989c87b3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Volume 7092dab7-6bac-45b1-815c-753ba40b4dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7092dab7-6bac-45b1-815c-753ba40b4dfa', 'volume_size': 1} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (ad998ab1-4b03-4584-add0-737c2c40298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad167e1c-7bbc-483c-9df7-572b3f253759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad167e1c-7bbc-483c-9df7-572b3f253759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1684515822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531d3ea6-d9ab-4120-b50e-5c115f5ea68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:41Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d20627-a450-4363-92bb-d575a59640a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d20627-a450-4363-92bb-d575a59640a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b71815b-3587-4053-b3fa-a7f6154cf1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b71815b-3587-4053-b3fa-a7f6154cf1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531d3ea6-d9ab-4120-b50e-5c115f5ea68b', 'volume_name': 'volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5ee233-26db-4827-9ac1-0b472e08dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5ee233-26db-4827-9ac1-0b472e08dc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169fdcfd-232b-4016-9a07-bb6baeaa809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:40 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Volume 531d3ea6-d9ab-4120-b50e-5c115f5ea68b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b', 'volume_size': 1} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef 1073741824" returned: 0 in 0.629s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:40 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef Nov 05 04:05:40 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:41 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (abaf0256-0f62-4635-953c-26f44569c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f885ae-0f40-4a2a-bc6a-2132c04b085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" returned: 0 in 0.338s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1330981255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8740fd-36be-4cc7-9d93-93c4d9000c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:40Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Creating volume 8a8740fd-36be-4cc7-9d93-93c4d9000c7c {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:41 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f885ae-0f40-4a2a-bc6a-2132c04b085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1097158925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3e786a-61f7-40e6-b02f-7c83efbf38ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:41Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca9300d-e713-4beb-8f3f-b4d6b4513bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca9300d-e713-4beb-8f3f-b4d6b4513bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c0e887-913b-4500-8f3d-86801e4bba88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c0e887-913b-4500-8f3d-86801e4bba88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3e786a-61f7-40e6-b02f-7c83efbf38ff', 'volume_name': 'volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c 1073741824 Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec10366-dd3d-41eb-a5c0-db883491c43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec10366-dd3d-41eb-a5c0-db883491c43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc0bbba-d032-4176-b51a-7da0c6e401e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Volume dc3e786a-61f7-40e6-b02f-7c83efbf38ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff', 'volume_size': 1} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2dc3ad-3d3d-43b4-a69d-5d51dbde37eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea42db4a-179b-4237-8378-286191e1f514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef (67f00d26-a9b4-40f8-a1ba-e547ccdf23ef): created successfully Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea42db4a-179b-4237-8378-286191e1f514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (d290efd2-5ddb-4043-8c0f-0046ca4fb15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:41 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a98fb70e-af9e-4436-9d96-05b1df6ef562 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created volume successfully. Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (fa8cc915-c17f-40d2-b171-37bbfe8aec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbd15f5-e082-4c78-88aa-4f54ccc6d3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbd15f5-e082-4c78-88aa-4f54ccc6d3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-668062976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16291ebd-7ca2-4a46-b81b-aa4365676249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:42Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8dac38-59dc-4630-a513-b17bf2b1e360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8dac38-59dc-4630-a513-b17bf2b1e360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908fb364-00ae-4cfe-b479-f1f6247e816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908fb364-00ae-4cfe-b479-f1f6247e816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16291ebd-7ca2-4a46-b81b-aa4365676249', 'volume_name': 'volume-16291ebd-7ca2-4a46-b81b-aa4365676249', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6db92a-5e94-4c36-bd1c-7abea3280ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6db92a-5e94-4c36-bd1c-7abea3280ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d959cc2-68f6-4cac-baf1-4efd49954c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:41 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Volume 16291ebd-7ca2-4a46-b81b-aa4365676249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16291ebd-7ca2-4a46-b81b-aa4365676249', 'volume_size': 1} Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:41 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c 1073741824" returned: 0 in 0.637s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:42 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c Nov 05 04:05:42 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Flow 'volume_create_manager' (b0cc464b-7c9a-435b-8406-1738e855d6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69325ff3-f4ec-4db0-8278-e2c34ebd5e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69325ff3-f4ec-4db0-8278-e2c34ebd5e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1399503342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18dacdd1-1c84-4569-b952-1e82203b8de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a27b8171a94e7a808857bc0ca3bea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:42Z,use_quota=True,user_id='d5f258c702574cdab8c49160e44b0d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0412eb0e-5338-4fe8-8445-c99bbb1810b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0412eb0e-5338-4fe8-8445-c99bbb1810b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111b4f90-8649-471c-9a03-0bcce0b385f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111b4f90-8649-471c-9a03-0bcce0b385f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18dacdd1-1c84-4569-b952-1e82203b8de2', 'volume_name': 'volume-18dacdd1-1c84-4569-b952-1e82203b8de2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff995ee-0c4c-4b17-a544-cc20bfa0fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff995ee-0c4c-4b17-a544-cc20bfa0fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e30789-46fa-4391-a414-86bdafe52f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:42 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Volume 18dacdd1-1c84-4569-b952-1e82203b8de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18dacdd1-1c84-4569-b952-1e82203b8de2', 'volume_size': 1} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:42 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c" returned: 0 in 0.272s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.804s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908872219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7092dab7-6bac-45b1-815c-753ba40b4dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:40Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Creating volume 7092dab7-6bac-45b1-815c-753ba40b4dfa {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:42 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:42 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa 1073741824 Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6b9fed-13a2-49ba-aa58-3238ea515295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:42 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8eb5df-f063-4680-946f-a249a6e3e824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:42 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Volume volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c (8a8740fd-36be-4cc7-9d93-93c4d9000c7c): created successfully Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8eb5df-f063-4680-946f-a249a6e3e824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (9117c4c2-f933-454b-8ad7-f44a3dfd6741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:42 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ac3053a4-f485-4b23-b89e-78bc624306f3 tempest-CreateVolumesFromImageTest-1550873851 None] Created volume successfully. Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:42 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa 1073741824" returned: 0 in 0.602s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:42 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa Nov 05 04:05:42 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:43 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Flow 'volume_create_manager' (bb465a73-9383-4722-a673-298e693abb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3688ccf5-0d95-4339-b23a-0ec9bb7ca2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa" returned: 0 in 0.321s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1684515822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531d3ea6-d9ab-4120-b50e-5c115f5ea68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:41Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Creating volume 531d3ea6-d9ab-4120-b50e-5c115f5ea68b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:43 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3688ccf5-0d95-4339-b23a-0ec9bb7ca2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9222d97b-42b3-4e5b-bb17-9789dd12a48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1647995dd5344cde9c4e8b6d1d3e46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:43Z,use_quota=True,user_id='207ad9cd85aa4ae797518acfd6c8b0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e9ba533-e71e-4029-97a5-e581eae015fb),volume_type_id=7e9ba533-e71e-4029-97a5-e581eae015fb)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:43 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b 1073741824 Nov 05 04:05:43 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d217a85d-2a12-44a2-8294-0ae65e1e2a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d217a85d-2a12-44a2-8294-0ae65e1e2a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f183c497-26d9-43f4-8408-88edf1f84b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d00386-b61e-428b-b1c0-25989c87b3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7092dab7-6bac-45b1-815c-753ba40b4dfa', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4253591-781e-48a9-8984-449f8c72e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:43 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Volume volume-7092dab7-6bac-45b1-815c-753ba40b4dfa (7092dab7-6bac-45b1-815c-753ba40b4dfa): created successfully Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4253591-781e-48a9-8984-449f8c72e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (a0b11bea-324f-45d2-aa5f-8f8d05c7f2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:43 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3f6e994f-bab8-4166-b0ae-500c88361fd8 tempest-CreateVolumesFromImageTest-1550873851 None] Created volume successfully. Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f183c497-26d9-43f4-8408-88edf1f84b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9222d97b-42b3-4e5b-bb17-9789dd12a48a', 'volume_name': 'volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a', 'volume_size': 1, 'image_id': '704f2739-fefc-47c6-b89f-ca979f28b1d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/704f2739-fefc-47c6-b89f-ca979f28b1d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1525e3c937ff2fd0ad0825cc06a150e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1647995dd5344cde9c4e8b6d1d3e46cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a034b4a2018079cd7f20de78ca5ed87c43982facf502a96aec7f2c658d65cb3cd20b6088317160964de89454fcdc43a42912239f0456c3c4186e65c16b03ab0', 'id': '704f2739-fefc-47c6-b89f-ca979f28b1d7', 'created_at': datetime.datetime(2026, 11, 5, 3, 5, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 5, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/704f2739-fefc-47c6-b89f-ca979f28b1d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f929bb9b-c208-43ee-9509-052902bf1689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f929bb9b-c208-43ee-9509-052902bf1689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49d06d6-0114-4c87-8486-039426ac1a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:43 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Volume 9222d97b-42b3-4e5b-bb17-9789dd12a48a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a', 'volume_size': 1, 'image_id': '704f2739-fefc-47c6-b89f-ca979f28b1d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/704f2739-fefc-47c6-b89f-ca979f28b1d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1525e3c937ff2fd0ad0825cc06a150e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1647995dd5344cde9c4e8b6d1d3e46cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a034b4a2018079cd7f20de78ca5ed87c43982facf502a96aec7f2c658d65cb3cd20b6088317160964de89454fcdc43a42912239f0456c3c4186e65c16b03ab0', 'id': '704f2739-fefc-47c6-b89f-ca979f28b1d7', 'created_at': datetime.datetime(2026, 11, 5, 3, 5, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 5, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/704f2739-fefc-47c6-b89f-ca979f28b1d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Trying to clone 9222d97b-42b3-4e5b-bb17-9789dd12a48a from image 704f2739-fefc-47c6-b89f-ca979f28b1d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/704f2739-fefc-47c6-b89f-ca979f28b1d7', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 04:05:43 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Image download 0.00 MB at 0.00 MB/s Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29e465b-2a99-46b9-96fe-ce99b1f60276]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:43 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b 1073741824" returned: 0 in 0.492s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:43 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD Nov 05 04:05:43 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:43 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b Nov 05 04:05:43 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:44 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:44 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b" returned: 0 in 0.249s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.678s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1097158925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3e786a-61f7-40e6-b02f-7c83efbf38ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:41Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Creating volume dc3e786a-61f7-40e6-b02f-7c83efbf38ff {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:44 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169fdcfd-232b-4016-9a07-bb6baeaa809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e22cd3-55c7-4ead-9a20-b55431a50687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:44 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff 1073741824 Nov 05 04:05:44 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:44 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Volume volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b (531d3ea6-d9ab-4120-b50e-5c115f5ea68b): created successfully Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e22cd3-55c7-4ead-9a20-b55431a50687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:44 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD Nov 05 04:05:44 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (ad998ab1-4b03-4584-add0-737c2c40298e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:44 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f8bc31b4-1f5c-419a-8a95-6de1e92270c0 tempest-CreateVolumesFromImageTest-1550873851 None] Created volume successfully. Nov 05 04:05:44 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Temporary image 704f2739-fefc-47c6-b89f-ca979f28b1d7 is fetched for user 207ad9cd85aa4ae797518acfd6c8b0e6. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf27882-71ef-4647-b960-544785628464]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:44 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff 1073741824" returned: 0 in 0.457s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:44 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD Nov 05 04:05:44 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:44 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff Nov 05 04:05:44 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:44 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:44 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.999s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-668062976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16291ebd-7ca2-4a46-b81b-aa4365676249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1b4ce9cf7742d3adf2a8f46886971f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:42Z,use_quota=True,user_id='883a0f3fd1104a07917cbc20211f98be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Creating volume 16291ebd-7ca2-4a46-b81b-aa4365676249 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:44 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc0bbba-d032-4176-b51a-7da0c6e401e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0a6949-f2a2-4786-8c32-b5d49f708467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:44 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 1073741824 Nov 05 04:05:44 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:44 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Volume volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff (dc3e786a-61f7-40e6-b02f-7c83efbf38ff): created successfully Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0a6949-f2a2-4786-8c32-b5d49f708467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (abaf0256-0f62-4635-953c-26f44569c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:44 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-21a88b09-2232-46f0-9d63-b790f1db977e tempest-CreateVolumesFromImageTest-1550873851 None] Created volume successfully. Nov 05 04:05:44 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD Nov 05 04:05:44 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:45 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:45 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 1073741824" returned: 0 in 0.494s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:45 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 Nov 05 04:05:45 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:45 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249" returned: 0 in 0.246s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.425s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1399503342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18dacdd1-1c84-4569-b952-1e82203b8de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a27b8171a94e7a808857bc0ca3bea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:42Z,use_quota=True,user_id='d5f258c702574cdab8c49160e44b0d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Creating volume 18dacdd1-1c84-4569-b952-1e82203b8de2 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:45 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:45 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 1073741824 Nov 05 04:05:45 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d959cc2-68f6-4cac-baf1-4efd49954c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16291ebd-7ca2-4a46-b81b-aa4365676249', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad8db83-2312-431e-9ba9-87eb3a901710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:45 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Volume volume-16291ebd-7ca2-4a46-b81b-aa4365676249 (16291ebd-7ca2-4a46-b81b-aa4365676249): created successfully Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad8db83-2312-431e-9ba9-87eb3a901710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Flow 'volume_create_manager' (fa8cc915-c17f-40d2-b171-37bbfe8aec50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:45 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-085ebb41-ce9a-42a0-a805-9c92815870c0 tempest-CreateVolumesFromImageTest-1550873851 None] Created volume successfully. Nov 05 04:05:46 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 1073741824" returned: 0 in 0.427s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:46 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 Nov 05 04:05:46 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:46 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2" returned: 0 in 0.266s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.725s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e30789-46fa-4391-a414-86bdafe52f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18dacdd1-1c84-4569-b952-1e82203b8de2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a1fe23-1f4b-4628-a34b-dc5e355a3159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Creating offline snapshot f65bd86e-d185-4dc5-8fb7-b42477f0ef4d of volume 67f00d26-a9b4-40f8-a1ba-e547ccdf23ef {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:05:46 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Volume volume-18dacdd1-1c84-4569-b952-1e82203b8de2 (18dacdd1-1c84-4569-b952-1e82203b8de2): created successfully Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a1fe23-1f4b-4628-a34b-dc5e355a3159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Flow 'volume_create_manager' (b0cc464b-7c9a-435b-8406-1738e855d6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd3fa54-41a0-4533-82e2-94daf7995ca0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-16291ebd-7ca2-4a46-b81b-aa4365676249-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-69514d58-3630-4442-922a-2e47a58b1d79 tempest-CinderUnicodeTest-1845293149 None] Created volume successfully. Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-16291ebd-7ca2-4a46-b81b-aa4365676249-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-quobyte-16291ebd-7ca2-4a46-b81b-aa4365676249" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-16291ebd-7ca2-4a46-b81b-aa4365676249" acquired by "delete_volume" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:46 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef Nov 05 04:05:46 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa5bbc-c882-4cf7-bd93-831166dba66f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:46 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 Nov 05 04:05:46 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:46 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" returned: 0 in 0.385s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:46 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d 1G Nov 05 04:05:46 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:46 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249" returned: 0 in 0.400s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:47 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249 Nov 05 04:05:47 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:47 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d 1G" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:47 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-16291ebd-7ca2-4a46-b81b-aa4365676249" returned: 0 in 0.282s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:47 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d Nov 05 04:05:47 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-16291ebd-7ca2-4a46-b81b-aa4365676249" released by "delete_volume" :: held 0.736s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Created reservations ['90c8321b-686a-4b60-b325-3d6cd2e8ee9f', 'f4505be9-bb5c-49fc-a36c-7b2b64e1867a', 'af66615e-9a98-49ce-b67f-1592ccb38067', '145c4038-e4cb-4113-b956-61407943da13'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:47 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:47 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-dc3e786a-61f7-40e6-b02f-7c83efbf38ff-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:47 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-dc3e786a-61f7-40e6-b02f-7c83efbf38ff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d" returned: 0 in 0.419s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:47 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d is being set with open permissions: ugo+rw Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:47 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d Nov 05 04:05:47 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-quobyte-dc3e786a-61f7-40e6-b02f-7c83efbf38ff" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-dc3e786a-61f7-40e6-b02f-7c83efbf38ff" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:47 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.387s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:47 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Deleted volume successfully. Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f35d91-1ffb-4f58-b9f5-ab76736eaea1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-90d81bfa-50af-4d3c-b087-92d6ffd75870 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-16291ebd-7ca2-4a46-b81b-aa4365676249-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:47 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d" returned: 0 in 0.289s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:47 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff Nov 05 04:05:47 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:48 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.info Nov 05 04:05:48 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:48 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff" returned: 0 in 0.371s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:48 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff Nov 05 04:05:48 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:48 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.info" returned: 0 in 0.267s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:48 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.info is being set with open permissions: ugo+rw Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:48 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.info Nov 05 04:05:48 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:48 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-dc3e786a-61f7-40e6-b02f-7c83efbf38ff" returned: 0 in 0.272s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:48 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.info" returned: 0 in 0.248s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-dc3e786a-61f7-40e6-b02f-7c83efbf38ff" released by "delete_volume" :: held 0.729s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.342s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9222d97b-42b3-4e5b-bb17-9789dd12a48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1647995dd5344cde9c4e8b6d1d3e46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:43Z,use_quota=True,user_id='207ad9cd85aa4ae797518acfd6c8b0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e9ba533-e71e-4029-97a5-e581eae015fb),volume_type_id=7e9ba533-e71e-4029-97a5-e581eae015fb)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Creating volume 9222d97b-42b3-4e5b-bb17-9789dd12a48a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:48 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:48 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a 1073741824 Nov 05 04:05:48 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-13909fe9-7da1-42c7-a959-acd2780cdf63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Create snapshot completed successfully Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Created reservations ['9bff515e-3444-440c-92d8-a05a968bb0b7', 'f9d11a18-8d9d-4ea8-9324-89914d6b933b', '408446f3-ea0f-435c-9774-269343d9e844', '5dcf3381-8aab-4857-9c72-23c21f87ede9'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:48 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:48 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-531d3ea6-d9ab-4120-b50e-5c115f5ea68b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-531d3ea6-d9ab-4120-b50e-5c115f5ea68b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-quobyte-531d3ea6-d9ab-4120-b50e-5c115f5ea68b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-531d3ea6-d9ab-4120-b50e-5c115f5ea68b" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb958a-bda8-43c3-b697-29c77290609c]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:49 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.334s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Deleted volume successfully. Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a45cde9-c04a-468d-8a2b-5ca64b8af8dc tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-dc3e786a-61f7-40e6-b02f-7c83efbf38ff-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:49 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b Nov 05 04:05:49 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:49 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a 1073741824" returned: 0 in 0.624s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:49 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a Nov 05 04:05:49 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:49 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b" returned: 0 in 0.411s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:49 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b Nov 05 04:05:49 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (bd949b5b-eb01-4744-a706-5bfca744c0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:49 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989be27d-b849-48b0-af5f-92d7bade6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a" returned: 0 in 0.321s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.771s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989be27d-b849-48b0-af5f-92d7bade6094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-719159838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e471f06-66ef-42a6-8b95-9dcdc78a378f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:49Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c39087-14fa-4403-bf48-8779cdbe9230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c39087-14fa-4403-bf48-8779cdbe9230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc2175b-d4a4-4350-8f20-dc52dd7f8fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc2175b-d4a4-4350-8f20-dc52dd7f8fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e471f06-66ef-42a6-8b95-9dcdc78a378f', 'volume_name': 'volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f26b8e-8785-4715-96a1-f34c374972f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f26b8e-8785-4715-96a1-f34c374972f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aeb79ea-dcab-428e-98da-c2b4962e7370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:49 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume 9e471f06-66ef-42a6-8b95-9dcdc78a378f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f', 'volume_size': 1} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Creating offline snapshot 0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc of volume 18dacdd1-1c84-4569-b952-1e82203b8de2 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Attempting download of 704f2739-fefc-47c6-b89f-ca979f28b1d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/704f2739-fefc-47c6-b89f-ca979f28b1d7', 'metadata': {}}])) to volume 9222d97b-42b3-4e5b-bb17-9789dd12a48a. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eb7d21-3f9b-488a-a18e-071a0dcce06f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adae4a9-3595-4ec8-8fe4-3aa40dcb02ff]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_704f2739-fefc-47c6-b89f-ca979f28b1d7_pf6ranh0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:49 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:49 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 Nov 05 04:05:49 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-531d3ea6-d9ab-4120-b50e-5c115f5ea68b" returned: 0 in 0.415s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-531d3ea6-d9ab-4120-b50e-5c115f5ea68b" released by "delete_volume" :: held 0.891s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:49 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_704f2739-fefc-47c6-b89f-ca979f28b1d7_pf6ranh0 Nov 05 04:05:49 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Created reservations ['641163b5-d3e4-4dbc-8a1b-cd5dd6e2becd', '2072d8f9-f82c-4b17-b525-e15d86acfd6f', '4aaed788-e6bd-4478-ad0a-0902b559496a', '0c6ed00c-e491-4e43-85d9-bf2eecebafec'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (5791c55e-93fd-4924-98a2-05ef9ae9ae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87efead3-7151-4f2e-b461-254be8d7e7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87efead3-7151-4f2e-b461-254be8d7e7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-610648073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c420f35a-8b5e-4d09-a643-563fb95b58c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:50Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3234b69-46a5-4ee7-9c98-e3098703f094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3234b69-46a5-4ee7-9c98-e3098703f094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28001e39-30c7-4035-bba0-53b6e88cc6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28001e39-30c7-4035-bba0-53b6e88cc6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c420f35a-8b5e-4d09-a643-563fb95b58c8', 'volume_name': 'volume-c420f35a-8b5e-4d09-a643-563fb95b58c8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73924d51-3afc-44b6-a3c0-94ce080c6772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73924d51-3afc-44b6-a3c0-94ce080c6772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bab865-992a-4bfb-b9d5-bb3111e17fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume c420f35a-8b5e-4d09-a643-563fb95b58c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c420f35a-8b5e-4d09-a643-563fb95b58c8', 'volume_size': 1} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2" returned: 0 in 0.568s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:50 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc 1G Nov 05 04:05:50 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:50 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_704f2739-fefc-47c6-b89f-ca979f28b1d7_pf6ranh0" returned: 0 in 0.529s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_704f2739-fefc-47c6-b89f-ca979f28b1d7_pf6ranh0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:50 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:50 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:50 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_704f2739-fefc-47c6-b89f-ca979f28b1d7_pf6ranh0 Nov 05 04:05:50 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:50 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.365s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Deleted volume successfully. Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6a5c8f3d-9a06-48b3-b69b-ef2c105dcbd5 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-531d3ea6-d9ab-4120-b50e-5c115f5ea68b-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:50 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc 1G" returned: 0 in 0.528s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dacdd1-1c84-4569-b952-1e82203b8de2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:50 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dacdd1-1c84-4569-b952-1e82203b8de2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc Nov 05 04:05:50 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:50 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (b3b1d8d4-713e-4a6b-9e98-33b1161c5dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fb7f89-c27e-4616-b9d6-60871b1571a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_704f2739-fefc-47c6-b89f-ca979f28b1d7_pf6ranh0" returned: 1 in 0.524s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_704f2739-fefc-47c6-b89f-ca979f28b1d7_pf6ranh0' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e76ced6-611e-420d-97dd-f3d52734ad02]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fb7f89-c27e-4616-b9d6-60871b1571a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1539152624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb0ae41-fce3-4ee7-afc2-7f53b1476088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:51Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893d36ca-28d9-4b20-b158-f0f54b1efc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893d36ca-28d9-4b20-b158-f0f54b1efc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255da954-9089-4c5c-bfc8-9bd83aed7dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255da954-9089-4c5c-bfc8-9bd83aed7dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb0ae41-fce3-4ee7-afc2-7f53b1476088', 'volume_name': 'volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6af08e-f70d-45a3-babf-19b8d3050cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6af08e-f70d-45a3-babf-19b8d3050cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe46a87-7c83-41b1-be1b-b684ba650c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume fbb0ae41-fce3-4ee7-afc2-7f53b1476088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088', 'volume_size': 1} Nov 05 04:05:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:51 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD Nov 05 04:05:51 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:51 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (1fc1869c-09ba-41e8-b8e2-ef543acb9af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91eb4125-9b1e-466e-b9b7-4e96e833906b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dacdd1-1c84-4569-b952-1e82203b8de2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc" returned: 0 in 0.448s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:51 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc is being set with open permissions: ugo+rw Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-7092dab7-6bac-45b1-815c-753ba40b4dfa-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91eb4125-9b1e-466e-b9b7-4e96e833906b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147574445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdc8afb-8d23-4b10-990b-7872e1baf08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:51Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:51 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc Nov 05 04:05:51 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35bdcc81-ced3-40ee-89fb-d6ed1f10ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35bdcc81-ced3-40ee-89fb-d6ed1f10ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f06106-bab5-4ad7-ae1f-ea778c3012d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f06106-bab5-4ad7-ae1f-ea778c3012d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffdc8afb-8d23-4b10-990b-7872e1baf08d', 'volume_name': 'volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2668d4c4-15a1-4736-8877-1e58166fd27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2668d4c4-15a1-4736-8877-1e58166fd27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b658b800-866a-43c8-b008-62c19621f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume ffdc8afb-8d23-4b10-990b-7872e1baf08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d', 'volume_size': 1} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:51 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-7092dab7-6bac-45b1-815c-753ba40b4dfa-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-quobyte-7092dab7-6bac-45b1-815c-753ba40b4dfa" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-7092dab7-6bac-45b1-815c-753ba40b4dfa" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:51 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD Nov 05 04:05:51 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[54762f07-c348-4c22-bae1-2ef6fab46035]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:51 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc" returned: 0 in 0.359s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:51 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa Nov 05 04:05:51 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:51 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.info Nov 05 04:05:51 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (8e60b9d8-585f-4e73-a3c2-307d9ce35553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfbf95e-cec9-4be4-98cf-184043376bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfbf95e-cec9-4be4-98cf-184043376bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-900928910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f166f7-0136-476f-b73e-cff12061b0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:52Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0607c14d-2095-4393-9411-246f6471199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0607c14d-2095-4393-9411-246f6471199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e25773-c0a2-4402-8652-15500454112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e25773-c0a2-4402-8652-15500454112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f166f7-0136-476f-b73e-cff12061b0d2', 'volume_name': 'volume-a2f166f7-0136-476f-b73e-cff12061b0d2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03982b0c-9a91-4ff0-afb9-f6cb20ce243e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03982b0c-9a91-4ff0-afb9-f6cb20ce243e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b673eaec-6def-4a01-9337-51c59b57c9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:51 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume a2f166f7-0136-476f-b73e-cff12061b0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f166f7-0136-476f-b73e-cff12061b0d2', 'volume_size': 1} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:51 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD" returned: 1 in 0.498s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] 704f2739-fefc-47c6-b89f-ca979f28b1d7 was raw, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:51 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a Nov 05 04:05:51 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:51 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.info" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:51 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.info is being set with open permissions: ugo+rw Nov 05 04:05:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:51 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.info Nov 05 04:05:51 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:51 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa" returned: 0 in 0.504s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:52 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa Nov 05 04:05:52 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:52 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.info" returned: 0 in 0.279s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.609s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-719159838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e471f06-66ef-42a6-8b95-9dcdc78a378f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:49Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:52 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Creating volume 9e471f06-66ef-42a6-8b95-9dcdc78a378f {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:52 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7092dab7-6bac-45b1-815c-753ba40b4dfa" returned: 0 in 0.305s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:52 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f 1073741824 Nov 05 04:05:52 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-7092dab7-6bac-45b1-815c-753ba40b4dfa" released by "delete_volume" :: held 0.883s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-49e4345e-1211-40b7-aa86-69df9300c8b6 tempest-CinderUnicodeTest-1845293149 None] Create snapshot completed successfully Nov 05 04:05:52 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a" returned: 0 in 0.511s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_704f2739-fefc-47c6-b89f-ca979f28b1d7_tp9d_6jcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:05:52 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:52 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a 1G Nov 05 04:05:52 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Created reservations ['eb08fb64-88bf-4ce2-aa65-350a96694c1a', '6bb6d0da-0489-4de1-b0fe-0ed14421f0b8', 'ebb15045-d46d-45d1-9225-fb4d6d6f4319', '9987fe76-8e2c-416d-9d43-663a826770aa'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:52 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:52 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:52 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a 1G" returned: 0 in 0.411s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Downloaded image 704f2739-fefc-47c6-b89f-ca979f28b1d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/704f2739-fefc-47c6-b89f-ca979f28b1d7', 'metadata': {}}])) to volume 9222d97b-42b3-4e5b-bb17-9789dd12a48a successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Temporary image 704f2739-fefc-47c6-b89f-ca979f28b1d7 for user 207ad9cd85aa4ae797518acfd6c8b0e6 is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Marking volume 9222d97b-42b3-4e5b-bb17-9789dd12a48a as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 04:05:52 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Copying metadata from image 704f2739-fefc-47c6-b89f-ca979f28b1d7 to 9222d97b-42b3-4e5b-bb17-9789dd12a48a. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Creating volume glance metadata for volume 9222d97b-42b3-4e5b-bb17-9789dd12a48a backed by image 704f2739-fefc-47c6-b89f-ca979f28b1d7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '704f2739-fefc-47c6-b89f-ca979f28b1d7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a1525e3c937ff2fd0ad0825cc06a150e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f 1073741824" returned: 0 in 0.516s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:52 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.328s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Deleted volume successfully. Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:52 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f Nov 05 04:05:52 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16df2020-256e-4d18-b514-23e7f9ece4cd tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-7092dab7-6bac-45b1-815c-753ba40b4dfa-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49d06d6-0114-4c87-8486-039426ac1a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a', 'volume_size': 1, 'image_id': '704f2739-fefc-47c6-b89f-ca979f28b1d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/704f2739-fefc-47c6-b89f-ca979f28b1d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1525e3c937ff2fd0ad0825cc06a150e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1647995dd5344cde9c4e8b6d1d3e46cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a034b4a2018079cd7f20de78ca5ed87c43982facf502a96aec7f2c658d65cb3cd20b6088317160964de89454fcdc43a42912239f0456c3c4186e65c16b03ab0', 'id': '704f2739-fefc-47c6-b89f-ca979f28b1d7', 'created_at': datetime.datetime(2026, 11, 5, 3, 5, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 5, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/704f2739-fefc-47c6-b89f-ca979f28b1d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8de903-a87d-4b22-8636-bd843ed913f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Volume volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a (9222d97b-42b3-4e5b-bb17-9789dd12a48a): created successfully Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8de903-a87d-4b22-8636-bd843ed913f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Flow 'volume_create_manager' (bb465a73-9383-4722-a673-298e693abb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-90fec3a4-b34c-4954-9928-b66fce53108a tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Created volume successfully. Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "cinder-0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "cinder-quobyte-18dacdd1-1c84-4569-b952-1e82203b8de2" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:53 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-quobyte-18dacdd1-1c84-4569-b952-1e82203b8de2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "cinder-quobyte-0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.876s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-610648073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c420f35a-8b5e-4d09-a643-563fb95b58c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:50Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Creating volume c420f35a-8b5e-4d09-a643-563fb95b58c8 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:53 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aeb79ea-dcab-428e-98da-c2b4962e7370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc961013-9464-49b7-a36b-5ffb64f210ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:53 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 1073741824 Nov 05 04:05:53 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-quobyte-0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Deleting offline snapshot 0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc of volume 18dacdd1-1c84-4569-b952-1e82203b8de2 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] snapshot_file for this snap is: volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:05:53 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f (9e471f06-66ef-42a6-8b95-9dcdc78a378f): created successfully Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc961013-9464-49b7-a36b-5ffb64f210ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (bd949b5b-eb01-4744-a706-5bfca744c0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ef7cd2-9fc4-47da-87b0-828d7d9b0ef7]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:53 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-01194cb9-689d-42d2-b670-8e1cdd7d03b3 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created volume successfully. Nov 05 04:05:53 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc Nov 05 04:05:53 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-8a8740fd-36be-4cc7-9d93-93c4d9000c7c-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-8a8740fd-36be-4cc7-9d93-93c4d9000c7c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "cinder-quobyte-8a8740fd-36be-4cc7-9d93-93c4d9000c7c" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-8a8740fd-36be-4cc7-9d93-93c4d9000c7c" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:53 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc" returned: 0 in 0.458s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18dacdd1-1c84-4569-b952-1e82203b8de2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:05:53 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c134bd-0cda-4f36-a64d-f8bad7dbb2e4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5689ea-6574-43d8-90ae-e3b11e95bf74]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 1073741824" returned: 0 in 0.611s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:53 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 Nov 05 04:05:53 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:53 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c Nov 05 04:05:53 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:53 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 Nov 05 04:05:53 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Acquiring lock "cinder-9222d97b-42b3-4e5b-bb17-9789dd12a48a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:54 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.147s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1539152624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb0ae41-fce3-4ee7-afc2-7f53b1476088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:51Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Creating volume fbb0ae41-fce3-4ee7-afc2-7f53b1476088 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:54 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bab865-992a-4bfb-b9d5-bb3111e17fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c420f35a-8b5e-4d09-a643-563fb95b58c8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd079a5-6174-4af1-9433-2ee872d24e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:54 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 1073741824 Nov 05 04:05:54 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "cinder-9222d97b-42b3-4e5b-bb17-9789dd12a48a-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:54 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 (c420f35a-8b5e-4d09-a643-563fb95b58c8): created successfully Nov 05 04:05:54 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd079a5-6174-4af1-9433-2ee872d24e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (5791c55e-93fd-4924-98a2-05ef9ae9ae27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c" returned: 0 in 0.477s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2" returned: 0 in 0.471s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:54 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c Nov 05 04:05:54 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:54 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f8807c60-e85c-43a9-88db-0a468532696d tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created volume successfully. Nov 05 04:05:54 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc Nov 05 04:05:54 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Acquiring lock "cinder-quobyte-9222d97b-42b3-4e5b-bb17-9789dd12a48a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "cinder-quobyte-9222d97b-42b3-4e5b-bb17-9789dd12a48a" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8502a059-a8af-4100-aa43-791b0fbe36bd]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:54 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a Nov 05 04:05:54 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:54 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-8a8740fd-36be-4cc7-9d93-93c4d9000c7c" returned: 0 in 0.320s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-quobyte-8a8740fd-36be-4cc7-9d93-93c4d9000c7c" released by "delete_volume" :: held 0.871s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Created reservations ['e307649a-11ab-4203-9c25-b3766bd3b428', 'c8dd65b5-0134-41a8-8860-7a53304b4962', 'ee44da89-380d-40dd-b0a3-deaea12d2a8a', '8e6a99da-6dad-4008-89cd-c44b085cf792'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:54 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc" returned: 0 in 0.421s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:54 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc Nov 05 04:05:54 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:54 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 1073741824" returned: 0 in 0.628s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:54 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a" returned: 0 in 0.461s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:54 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:54 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:54 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a Nov 05 04:05:54 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:54 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 Nov 05 04:05:54 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:55 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2.0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc" returned: 0 in 0.437s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:55 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-quobyte-0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc" released by "_delete_snapshot" :: held 1.957s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088" returned: 0 in 0.331s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-quobyte-18dacdd1-1c84-4569-b952-1e82203b8de2" released by "delete_snapshot" :: held 2.040s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:55 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.862s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147574445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdc8afb-8d23-4b10-990b-7872e1baf08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:51Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Creating volume ffdc8afb-8d23-4b10-990b-7872e1baf08d {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:55 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.492s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:55 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d 1073741824 Nov 05 04:05:55 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:55 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe46a87-7c83-41b1-be1b-b684ba650c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d44cd9-73c1-422c-a778-321d0b04807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9222d97b-42b3-4e5b-bb17-9789dd12a48a" returned: 0 in 0.471s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Deleted volume successfully. Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "cinder-quobyte-9222d97b-42b3-4e5b-bb17-9789dd12a48a" released by "delete_volume" :: held 0.995s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:55 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 (fbb0ae41-fce3-4ee7-afc2-7f53b1476088): created successfully Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d44cd9-73c1-422c-a778-321d0b04807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (b3b1d8d4-713e-4a6b-9e98-33b1161c5dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e31aff0-fca6-45d7-b7c5-c6f46e381501 tempest-CreateVolumesFromImageTest-1550873851 None] Lock "cinder-8a8740fd-36be-4cc7-9d93-93c4d9000c7c-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-45603327-159c-4ef5-87b9-d2e7d1c98a63 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created volume successfully. Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Created reservations ['45ed9592-e145-4ab1-8da3-81dccb11e1a3', 'd3384c86-b250-4273-98b2-071e6a848bbb', '57ae57ed-a1d5-46a8-9c76-764703dfc340', 'c3acaee7-e402-4000-abb4-3672f64625c9'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Created reservations ['45a6fded-4a2b-4503-8c5c-29f2d0ac8023', '9d01cfda-c586-4d70-adb5-17d09006c80d', '1d509687-1f37-4850-a599-ca1f3526ca57', 'f5afdb5d-fb1b-40cc-90f5-fc02c7bd2f52'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Delete snapshot completed successfully. Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc4515bd-0994-4f8a-998a-bf5907c1efd1 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-0dd715b6-8fa5-4daa-9c8c-e8603ee5bdbc-delete_snapshot" released by "delete_snapshot" :: held 2.419s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:55 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:55 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:55 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d 1073741824" returned: 0 in 0.494s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:55 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d Nov 05 04:05:55 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:55 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.354s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Deleted volume successfully. Nov 05 04:05:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c618f4d3-5269-448d-b8d4-855e49926830 tempest-VolumeAndVolumeTypeFromImageTest-667953895 None] Lock "cinder-9222d97b-42b3-4e5b-bb17-9789dd12a48a-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:56 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.229s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-900928910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f166f7-0136-476f-b73e-cff12061b0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c57be671b94e219a803f725c1b8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:52Z,use_quota=True,user_id='eb2bc09e284a49dfbcb5dff4d8a00317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Creating volume a2f166f7-0136-476f-b73e-cff12061b0d2 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:56 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b658b800-866a-43c8-b008-62c19621f265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:56 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 1073741824 Nov 05 04:05:56 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada0c4c8-d031-4a00-b1fa-6905e4f4d348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:56 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d (ffdc8afb-8d23-4b10-990b-7872e1baf08d): created successfully Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada0c4c8-d031-4a00-b1fa-6905e4f4d348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (1fc1869c-09ba-41e8-b8e2-ef543acb9af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9fbfc56d-fa01-4c6a-ae11-3b522fe5d7b1 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created volume successfully. Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "cinder-18dacdd1-1c84-4569-b952-1e82203b8de2-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-18dacdd1-1c84-4569-b952-1e82203b8de2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "cinder-quobyte-18dacdd1-1c84-4569-b952-1e82203b8de2" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-quobyte-18dacdd1-1c84-4569-b952-1e82203b8de2" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9750db5-453b-4381-9c1b-d8ce065f7b6f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:56 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 Nov 05 04:05:56 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:56 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 1073741824" returned: 0 in 0.607s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:56 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 Nov 05 04:05:56 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:56 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2" returned: 0 in 0.282s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:56 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2" returned: 0 in 0.469s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b673eaec-6def-4a01-9337-51c59b57c9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f166f7-0136-476f-b73e-cff12061b0d2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505a3a9b-dfd6-4a8f-a8b1-c2e9c2c22004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:57 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2 Nov 05 04:05:57 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:57 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Volume volume-a2f166f7-0136-476f-b73e-cff12061b0d2 (a2f166f7-0136-476f-b73e-cff12061b0d2): created successfully Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505a3a9b-dfd6-4a8f-a8b1-c2e9c2c22004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Flow 'volume_create_manager' (8e60b9d8-585f-4e73-a3c2-307d9ce35553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cb902305-3b92-42f2-acff-07e689b2e1fa tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created volume successfully. Nov 05 04:05:57 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-18dacdd1-1c84-4569-b952-1e82203b8de2" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-quobyte-18dacdd1-1c84-4569-b952-1e82203b8de2" released by "delete_volume" :: held 0.872s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Created reservations ['6da1b224-f092-46fd-b895-93d4ef8e36e9', '3f540cce-18cf-491a-bb1f-9fdd8b5243f6', 'a62f842c-ee7d-41ac-9989-3cfabaf1b94a', 'b3a78d87-08ee-4f2b-a234-5fdccb409c42'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-a2f166f7-0136-476f-b73e-cff12061b0d2-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-a2f166f7-0136-476f-b73e-cff12061b0d2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-quobyte-a2f166f7-0136-476f-b73e-cff12061b0d2" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:57 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:57 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-a2f166f7-0136-476f-b73e-cff12061b0d2" acquired by "delete_volume" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[320ba539-9c66-4051-8096-12a53827f9f5]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "cinder-a954673c-51ec-40e7-8a82-82b310213a76-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-a954673c-51ec-40e7-8a82-82b310213a76-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:57 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "cinder-quobyte-a954673c-51ec-40e7-8a82-82b310213a76" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-quobyte-a954673c-51ec-40e7-8a82-82b310213a76" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:57 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588f7c1-9fd9-43b4-bb84-f78ade02b35e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:57 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.484s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Deleted volume successfully. Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2bbf10d1-f64e-4377-806c-aa1b399e6b86 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-18dacdd1-1c84-4569-b952-1e82203b8de2-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:58 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 Nov 05 04:05:58 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:58 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2" returned: 0 in 0.629s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:58 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2 Nov 05 04:05:58 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:58 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76" returned: 0 in 0.500s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:58 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76 Nov 05 04:05:58 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:58 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a2f166f7-0136-476f-b73e-cff12061b0d2" returned: 0 in 0.410s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-a2f166f7-0136-476f-b73e-cff12061b0d2" released by "delete_volume" :: held 1.109s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created reservations ['13473ab7-4281-420a-93c6-67e1d812167f', '44a7a181-11f4-4082-8d91-73aebf552c58', '244ba88d-d73f-4fad-8bd4-ebefd2dba6ec', '34a308f5-4fd0-417e-b569-a26f18c943df'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:58 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-a954673c-51ec-40e7-8a82-82b310213a76" returned: 0 in 0.367s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-quobyte-a954673c-51ec-40e7-8a82-82b310213a76" released by "delete_volume" :: held 0.958s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:58 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Created reservations ['cb988c53-54d3-4b50-9429-929bb159ca32', '6349f19c-48b3-4b00-9052-a409935b996b', '786418d2-7e4e-4040-8d0b-2e6052775af6', '07a9e2ca-b73c-4ed7-9369-c20c5347b014'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:05:58 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:58 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:59 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:05:59 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (532a9b7a-8130-4075-bf4b-965aad223de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8481b7f-d454-46bd-90cb-914aaef19d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8481b7f-d454-46bd-90cb-914aaef19d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024091057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda06369-33cd-4bb2-9d94-2410904f40dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:59Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053133c4-e93b-4272-98fa-2cd513888627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053133c4-e93b-4272-98fa-2cd513888627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e217020d-c96d-4082-b92e-2bcb41ea9775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e217020d-c96d-4082-b92e-2bcb41ea9775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda06369-33cd-4bb2-9d94-2410904f40dc', 'volume_name': 'volume-fda06369-33cd-4bb2-9d94-2410904f40dc', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fb2a16-6986-497f-adac-439eda4b50d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fb2a16-6986-497f-adac-439eda4b50d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fe01bc-5f05-40d8-a680-4a61a658e7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:05:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume fda06369-33cd-4bb2-9d94-2410904f40dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda06369-33cd-4bb2-9d94-2410904f40dc', 'volume_size': 1} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024091057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda06369-33cd-4bb2-9d94-2410904f40dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:59Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Creating volume fda06369-33cd-4bb2-9d94-2410904f40dc {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:05:59 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:59 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc 1073741824 Nov 05 04:05:59 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:59 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.328s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Deleted volume successfully. Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4a1283ca-a2e6-48ff-8145-6ea6dcf70646 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-a2f166f7-0136-476f-b73e-cff12061b0d2-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:59 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.338s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:05:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Deleted volume successfully. Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-e83dcfc9-ec07-46ea-992e-81b3ee714200 tempest-CinderUnicodeTest-1845293149 None] Lock "cinder-a954673c-51ec-40e7-8a82-82b310213a76-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:05:59 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc 1073741824" returned: 0 in 0.494s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:05:59 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc Nov 05 04:05:59 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-ffdc8afb-8d23-4b10-990b-7872e1baf08d-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-ffdc8afb-8d23-4b10-990b-7872e1baf08d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-quobyte-ffdc8afb-8d23-4b10-990b-7872e1baf08d" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:05:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-ffdc8afb-8d23-4b10-990b-7872e1baf08d" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe66bfea-a0de-400c-aaee-d8a1337800e3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:00 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc" returned: 0 in 0.385s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fe01bc-5f05-40d8-a680-4a61a658e7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda06369-33cd-4bb2-9d94-2410904f40dc', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fef830-86bb-4e27-a8fd-18b99e5c9903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:00 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d Nov 05 04:06:00 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:00 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume volume-fda06369-33cd-4bb2-9d94-2410904f40dc (fda06369-33cd-4bb2-9d94-2410904f40dc): created successfully Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fef830-86bb-4e27-a8fd-18b99e5c9903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (532a9b7a-8130-4075-bf4b-965aad223de1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:00 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3a64f24a-c551-40bf-9627-90afb87353c0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created volume successfully. Nov 05 04:06:00 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d" returned: 0 in 0.400s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:00 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d Nov 05 04:06:00 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:00 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ffdc8afb-8d23-4b10-990b-7872e1baf08d" returned: 0 in 0.280s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-ffdc8afb-8d23-4b10-990b-7872e1baf08d" released by "delete_volume" :: held 0.775s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created reservations ['aef3eb7b-dcd8-4b8f-b46a-15c7d8743ea6', 'ce34a907-fa7a-49a8-a24d-9f70188018ef', 'd5bc3e7d-c91d-43b6-a320-c9c9ef7014cc', '8011226f-7f70-4626-af6f-54dad7ea0182'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:00 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:00 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-fbb0ae41-fce3-4ee7-afc2-7f53b1476088-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-fbb0ae41-fce3-4ee7-afc2-7f53b1476088-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-quobyte-fbb0ae41-fce3-4ee7-afc2-7f53b1476088" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-fbb0ae41-fce3-4ee7-afc2-7f53b1476088" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:01 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.355s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Deleted volume successfully. Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec5ad1a-5325-46de-a610-48561c1a2e22]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-0bed0425-9ca0-43ab-905a-b08c287d5fb4 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-ffdc8afb-8d23-4b10-990b-7872e1baf08d-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:01 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 Nov 05 04:06:01 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:01 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (45276428-995f-4f87-8cbd-4872451cfb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6b8115-6ba4-4f55-bb9d-bfe420f370ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088" returned: 0 in 0.621s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6b8115-6ba4-4f55-bb9d-bfe420f370ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-658049621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74344e77-92c5-4740-98c7-6262d306f358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:02Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d2d410-41b7-4845-bff3-c92fa38e14c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:01 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088 Nov 05 04:06:01 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d2d410-41b7-4845-bff3-c92fa38e14c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987157c6-4ed8-4852-b8ee-102c3b6d474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987157c6-4ed8-4852-b8ee-102c3b6d474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74344e77-92c5-4740-98c7-6262d306f358', 'volume_name': 'volume-74344e77-92c5-4740-98c7-6262d306f358', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe959923-2707-4317-a62b-b2508742d31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe959923-2707-4317-a62b-b2508742d31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b14f67f-ae0f-4723-bf3b-42a21b72bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:01 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume 74344e77-92c5-4740-98c7-6262d306f358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74344e77-92c5-4740-98c7-6262d306f358', 'volume_size': 1} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-658049621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74344e77-92c5-4740-98c7-6262d306f358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:02Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Creating volume 74344e77-92c5-4740-98c7-6262d306f358 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:01 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:02 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 1073741824 Nov 05 04:06:02 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:02 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fbb0ae41-fce3-4ee7-afc2-7f53b1476088" returned: 0 in 0.482s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-fbb0ae41-fce3-4ee7-afc2-7f53b1476088" released by "delete_volume" :: held 1.193s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created reservations ['25a5c3e6-b5d1-428d-9be8-5fabe4ee6504', '43aaa0a3-1063-44ed-8de9-effac32c247d', '497cd813-8aff-44cd-8f1c-734394e35161', '01cf3511-d845-4fe9-8d7f-7f362e858a71'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (9d16c56c-7144-4481-81b3-8e52393b313b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3805c8-d515-4b76-b7cc-c1d40cd04c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3805c8-d515-4b76-b7cc-c1d40cd04c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066385601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:02Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4448eb0-88cc-4b73-89dc-e63bf46e82e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4448eb0-88cc-4b73-89dc-e63bf46e82e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99d4b85-daba-4137-ae27-ee078cfcb81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99d4b85-daba-4137-ae27-ee078cfcb81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d', 'volume_name': 'volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4b6958-4bbf-4543-acf5-b6c4992f2d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4b6958-4bbf-4543-acf5-b6c4992f2d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e12211-f198-43ae-ae51-49065c040ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:02 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume 9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d', 'volume_size': 1} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:02 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 1073741824" returned: 0 in 0.780s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:02 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:02 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:02 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 Nov 05 04:06:02 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (4a2e1139-ce72-43d0-bc69-0e001231921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4b6aaf-8d54-4060-9c0e-d613fee878f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4b6aaf-8d54-4060-9c0e-d613fee878f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112798117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da412f52-e37b-4051-8423-f61077bb6626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:03Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0818f674-9073-4511-995d-d31c3168c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0818f674-9073-4511-995d-d31c3168c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced28e58-cc20-47de-8850-f3f948bcf213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced28e58-cc20-47de-8850-f3f948bcf213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da412f52-e37b-4051-8423-f61077bb6626', 'volume_name': 'volume-da412f52-e37b-4051-8423-f61077bb6626', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31c8e53-8c83-4dda-9690-f0306442ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31c8e53-8c83-4dda-9690-f0306442ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc51a7e2-59c9-4be3-990c-23fa80309092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume da412f52-e37b-4051-8423-f61077bb6626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da412f52-e37b-4051-8423-f61077bb6626', 'volume_size': 1} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358" returned: 0 in 0.542s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.579s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066385601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:02Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Creating volume 9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:03 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:03 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Deleted volume successfully. Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b14f67f-ae0f-4723-bf3b-42a21b72bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74344e77-92c5-4740-98c7-6262d306f358', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00372007-44bc-4891-875c-760f0d0758b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d 1073741824 Nov 05 04:06:03 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-c420f35a-8b5e-4d09-a643-563fb95b58c8-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume volume-74344e77-92c5-4740-98c7-6262d306f358 (74344e77-92c5-4740-98c7-6262d306f358): created successfully Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00372007-44bc-4891-875c-760f0d0758b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (45276428-995f-4f87-8cbd-4872451cfb87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4bdbe464-08bc-49c2-bb3e-0f809a400508 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-fbb0ae41-fce3-4ee7-afc2-7f53b1476088-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-c420f35a-8b5e-4d09-a643-563fb95b58c8-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:03 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f91cc8c8-2961-4e2f-8da4-1a49121d0e7c tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created volume successfully. Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-quobyte-c420f35a-8b5e-4d09-a643-563fb95b58c8" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-c420f35a-8b5e-4d09-a643-563fb95b58c8" acquired by "delete_volume" :: waited 0.037s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39a026-4202-48d7-bc2f-21504f418ce2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (83eae1bc-e2fe-41c9-bc33-1ee53dd55750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7afb82-b7c6-4105-8eea-50e4c1a48fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7afb82-b7c6-4105-8eea-50e4c1a48fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113001167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f115aeb5-500f-45b2-8df7-0989634ede7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:04Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f71d9e-932b-425e-abcb-bf576416fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f71d9e-932b-425e-abcb-bf576416fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300f528f-803a-4079-8926-c92a710b9eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300f528f-803a-4079-8926-c92a710b9eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f115aeb5-500f-45b2-8df7-0989634ede7c', 'volume_name': 'volume-f115aeb5-500f-45b2-8df7-0989634ede7c', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd9c293-4b21-4590-8959-352dd7490078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd9c293-4b21-4590-8959-352dd7490078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0066bc4-9d45-4b84-a233-0c39c368c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume f115aeb5-500f-45b2-8df7-0989634ede7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f115aeb5-500f-45b2-8df7-0989634ede7c', 'volume_size': 1} Nov 05 04:06:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:04 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 Nov 05 04:06:04 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:04 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d 1073741824" returned: 0 in 0.910s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:04 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d Nov 05 04:06:04 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (3a4c41d9-5fb2-456d-bb30-62c7063cabd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680dadee-05a8-429b-b569-f843a1f443d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680dadee-05a8-429b-b569-f843a1f443d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753822478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e7a88c-0e41-4149-8d4f-8e80aebc4e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:04Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bf1c18-31f8-4d5f-852f-889ebeb5b7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bf1c18-31f8-4d5f-852f-889ebeb5b7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3796e9-a065-4b4f-ae68-caf09ad28370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:04 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3796e9-a065-4b4f-ae68-caf09ad28370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e7a88c-0e41-4149-8d4f-8e80aebc4e7e', 'volume_name': 'volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34acbe6-54fb-4197-82d6-9c8be808c970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34acbe6-54fb-4197-82d6-9c8be808c970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ba9c73-bd6f-4087-a784-1475abdc06ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume 40e7a88c-0e41-4149-8d4f-8e80aebc4e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e', 'volume_size': 1} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8" returned: 0 in 0.740s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:04 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8 Nov 05 04:06:04 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:04 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d" returned: 0 in 0.412s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112798117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da412f52-e37b-4051-8423-f61077bb6626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:03Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Creating volume da412f52-e37b-4051-8423-f61077bb6626 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:04 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:04 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-c420f35a-8b5e-4d09-a643-563fb95b58c8" returned: 0 in 0.310s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:04 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 1073741824 Nov 05 04:06:04 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-c420f35a-8b5e-4d09-a643-563fb95b58c8" released by "delete_volume" :: held 1.147s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e12211-f198-43ae-ae51-49065c040ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2dee2d2-bbac-484a-adcb-47ebfc3e4059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d (9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d): created successfully Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2dee2d2-bbac-484a-adcb-47ebfc3e4059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (9d16c56c-7144-4481-81b3-8e52393b313b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:05 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-90d2e269-c926-4902-8689-c7cb80a52371 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created volume successfully. Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created reservations ['3b7382da-b1c0-4a7e-a58f-dc3ccc5fa864', 'd21996cf-b19d-4641-a503-666da4c36d46', '6876f1a2-0a89-4a98-94f7-2fbabf61818f', '60cf3ac5-2656-4573-a56f-9d028eadf71d'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:05 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:05 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:05 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 1073741824" returned: 0 in 0.543s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:05 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.352s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:05 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Deleted volume successfully. Nov 05 04:06:05 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 Nov 05 04:06:05 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-85a19880-1f90-424a-adb0-565ffec5914b tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-c420f35a-8b5e-4d09-a643-563fb95b58c8-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:05 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626" returned: 0 in 0.321s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113001167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f115aeb5-500f-45b2-8df7-0989634ede7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:04Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Creating volume f115aeb5-500f-45b2-8df7-0989634ede7c {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:05 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc51a7e2-59c9-4be3-990c-23fa80309092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da412f52-e37b-4051-8423-f61077bb6626', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813b5d11-1e8b-41fb-a676-43c216eb7081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:05 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c 1073741824 Nov 05 04:06:05 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:05 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume volume-da412f52-e37b-4051-8423-f61077bb6626 (da412f52-e37b-4051-8423-f61077bb6626): created successfully Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813b5d11-1e8b-41fb-a676-43c216eb7081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (4a2e1139-ce72-43d0-bc69-0e001231921f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-9e471f06-66ef-42a6-8b95-9dcdc78a378f-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:05 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-88f77377-a71c-471b-8d8b-9c123de622e0 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created volume successfully. Nov 05 04:06:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-9e471f06-66ef-42a6-8b95-9dcdc78a378f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-quobyte-9e471f06-66ef-42a6-8b95-9dcdc78a378f" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-9e471f06-66ef-42a6-8b95-9dcdc78a378f" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6833d76e-b2f2-4a78-a60a-9081a35456fc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:06 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f Nov 05 04:06:06 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:06 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c 1073741824" returned: 0 in 0.669s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:06 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c Nov 05 04:06:06 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:06 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f" returned: 0 in 0.519s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:06 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f Nov 05 04:06:06 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:06 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c" returned: 0 in 0.313s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.286s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753822478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e7a88c-0e41-4149-8d4f-8e80aebc4e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdfa0325f646d3b1983a98b8f3af23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:04Z,use_quota=True,user_id='578ecfacee0847e9a7c4d8732dac0144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Creating volume 40e7a88c-0e41-4149-8d4f-8e80aebc4e7e {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:06 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0066bc4-9d45-4b84-a233-0c39c368c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f115aeb5-500f-45b2-8df7-0989634ede7c', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:06 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e 1073741824 Nov 05 04:06:06 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48ba489-23ba-4515-839f-9a44ae319e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:06 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume volume-f115aeb5-500f-45b2-8df7-0989634ede7c (f115aeb5-500f-45b2-8df7-0989634ede7c): created successfully Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48ba489-23ba-4515-839f-9a44ae319e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (83eae1bc-e2fe-41c9-bc33-1ee53dd55750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:06 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6fc88949-e31a-41f7-bb18-325130973bea tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created volume successfully. Nov 05 04:06:06 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9e471f06-66ef-42a6-8b95-9dcdc78a378f" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:06 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-9e471f06-66ef-42a6-8b95-9dcdc78a378f" released by "delete_volume" :: held 0.891s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created reservations ['e896c3f5-c2c2-4040-809c-27ba85335e28', '80fa1459-4fbc-4497-9685-fe3cafb9075e', 'd46af63d-62a5-4465-b56e-1b3c8ea05764', 'f0c7de45-bfbd-4ae9-832d-50f3db47896b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:07 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:07 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:07 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e 1073741824" returned: 0 in 0.505s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:07 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.287s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:07 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Deleted volume successfully. Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:07 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e Nov 05 04:06:07 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7bc20533-e21f-4e9d-8590-b8a105597d83 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-9e471f06-66ef-42a6-8b95-9dcdc78a378f-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Flow 'volume_create_manager' (23f72d62-f579-4dbb-bcbf-2c57ef901998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc37bc14-c229-4c2d-869e-b48f68a56e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc37bc14-c229-4c2d-869e-b48f68a56e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32645f9-e5f7-4841-9cae-d62a8b01e44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9f24d30c8b481b891d0081c91e4b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:07Z,use_quota=True,user_id='8d680cd27ee14604a1a1f94567c0a06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb3dd92-64e5-472f-ab19-764cdb68fffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb3dd92-64e5-472f-ab19-764cdb68fffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50543b50-b02a-4eb5-9c9e-4b749f0de89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.image.glance [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Creating Keystone auth plugin from conf {{(pid=87111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 04:06:07 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e" returned: 0 in 0.285s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ba9c73-bd6f-4087-a784-1475abdc06ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453be96c-1583-44f3-b555-acc55612aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:07 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Volume volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e (40e7a88c-0e41-4149-8d4f-8e80aebc4e7e): created successfully Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453be96c-1583-44f3-b555-acc55612aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Flow 'volume_create_manager' (3a4c41d9-5fb2-456d-bb30-62c7063cabd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:07 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4150898f-23f1-4691-967a-8f74dd16e509 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created volume successfully. Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50543b50-b02a-4eb5-9c9e-4b749f0de89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f32645f9-e5f7-4841-9cae-d62a8b01e44b', 'volume_name': 'volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b', 'volume_size': 1, 'image_id': 'a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8caa1466db1eb6741550e130555f06c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a9f24d30c8b481b891d0081c91e4b86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6675738d4d61dcdaeae0117b081bb4e7c1da2961012b013de3a11be7eaf9310596f8df978182671e35feb4f43a00c5b6312c97250c695ab97e9def1c7ee88e49', 'id': 'a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'created_at': datetime.datetime(2026, 11, 5, 3, 6, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 6, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f/file', 'properties': {}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74532755-aad7-4bc2-833e-3e6fb567b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74532755-aad7-4bc2-833e-3e6fb567b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4fb16e0-f91d-4741-8864-05e5f6d3ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:07 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Volume f32645f9-e5f7-4841-9cae-d62a8b01e44b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b', 'volume_size': 1, 'image_id': 'a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8caa1466db1eb6741550e130555f06c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a9f24d30c8b481b891d0081c91e4b86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6675738d4d61dcdaeae0117b081bb4e7c1da2961012b013de3a11be7eaf9310596f8df978182671e35feb4f43a00c5b6312c97250c695ab97e9def1c7ee88e49', 'id': 'a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'created_at': datetime.datetime(2026, 11, 5, 3, 6, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 6, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f/file', 'properties': {}}, 'image_service': } Nov 05 04:06:07 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Trying to clone f32645f9-e5f7-4841-9cae-d62a8b01e44b from image a2dc80b0-7475-44e5-876d-b6c205faaf1f at location (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'metadata': {}}]). {{(pid=87111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-quobyte-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5dd3e2-33af-4a19-a5cc-9da0aebd22bd]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 04:06:08 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Image download 0.00 MB at 0.00 MB/s Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c5e0e1-c2ec-4678-ad17-72be91fc5760]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:08 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e Nov 05 04:06:08 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-f65bd86e-d185-4dc5-8fb7-b42477f0ef4d-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-f65bd86e-d185-4dc5-8fb7-b42477f0ef4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-quobyte-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-quobyte-f65bd86e-d185-4dc5-8fb7-b42477f0ef4d" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-f65bd86e-d185-4dc5-8fb7-b42477f0ef4d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:08 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD Nov 05 04:06:08 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Deleting offline snapshot f65bd86e-d185-4dc5-8fb7-b42477f0ef4d of volume 67f00d26-a9b4-40f8-a1ba-e547ccdf23ef {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] snapshot_file for this snap is: volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c511afa-ad6b-4be9-807f-ba281d7c5f0e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:08 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d Nov 05 04:06:08 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:08 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e" returned: 0 in 0.495s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:08 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:08 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e Nov 05 04:06:08 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:08 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD Nov 05 04:06:08 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:08 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e" returned: 0 in 0.302s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e" released by "delete_volume" :: held 0.846s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:08 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d" returned: 0 in 0.548s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c427d2f-8227-4be6-a8ef-6066ff1c6cea]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:08 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Temporary image a2dc80b0-7475-44e5-876d-b6c205faaf1f is fetched for user 8d680cd27ee14604a1a1f94567c0a06d. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 04:06:08 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created reservations ['5263b0e9-cbaf-4a1b-8f5e-87b02e260bf8', 'ebfccfbc-67f9-47c0-bd31-f65d7459ec93', '59fba476-22aa-491f-8566-76548eaaa9d1', '7f3cfad1-1262-4614-90a8-f7cdbf009f13'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd31fbc9-0623-46d6-8fa4-003f72f4576a]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:09 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef Nov 05 04:06:09 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-f115aeb5-500f-45b2-8df7-0989634ede7c-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:09 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:09 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-f115aeb5-500f-45b2-8df7-0989634ede7c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:09 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD Nov 05 04:06:09 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-quobyte-f115aeb5-500f-45b2-8df7-0989634ede7c" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-f115aeb5-500f-45b2-8df7-0989634ede7c" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc67f60-a793-4407-954d-97f557323f96]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:09 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" returned: 0 in 0.456s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:09 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.314s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:09 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c Nov 05 04:06:09 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:09 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Deleted volume successfully. Nov 05 04:06:09 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d Nov 05 04:06:09 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4e302fc0-c179-4a0d-b9ef-16f3efd2197b tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-40e7a88c-0e41-4149-8d4f-8e80aebc4e7e-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:09 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:09 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD Nov 05 04:06:09 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:09 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c" returned: 0 in 0.417s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:09 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c Nov 05 04:06:09 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:09 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d" returned: 0 in 0.397s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:09 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d Nov 05 04:06:09 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:09 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32645f9-e5f7-4841-9cae-d62a8b01e44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9f24d30c8b481b891d0081c91e4b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:07Z,use_quota=True,user_id='8d680cd27ee14604a1a1f94567c0a06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Creating volume f32645f9-e5f7-4841-9cae-d62a8b01e44b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:09 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:09 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:09 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b 1073741824 Nov 05 04:06:09 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:10 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f115aeb5-500f-45b2-8df7-0989634ede7c" returned: 0 in 0.355s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-f115aeb5-500f-45b2-8df7-0989634ede7c" released by "delete_volume" :: held 0.849s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:10 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef.f65bd86e-d185-4dc5-8fb7-b42477f0ef4d" returned: 0 in 0.319s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-f65bd86e-d185-4dc5-8fb7-b42477f0ef4d" released by "_delete_snapshot" :: held 1.884s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" released by "delete_snapshot" :: held 1.919s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created reservations ['b2a3c6ca-7e16-4132-b8f6-40577836293d', '9a88fd59-3a42-4616-af17-bc42b5e82457', '58bc8db2-93f8-43f6-9acb-96d78afc5527', 'f9992f82-f37c-4d24-b6ee-f0746fe5c33b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created reservations ['b6731a82-b469-4431-814b-bbedc633ef82', 'cbf028a6-7ffe-4331-9947-950b65ea48af', '27cb715d-b1ef-4449-81fe-79510cb3fdc4', '7cbc049f-6d30-4951-9f61-c7ce9ddf7097'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:10 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:10 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Delete snapshot completed successfully. Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bddb685a-6846-4935-b242-9f80e641afa9 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-f65bd86e-d185-4dc5-8fb7-b42477f0ef4d-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:10 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b 1073741824" returned: 0 in 0.581s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:10 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b Nov 05 04:06:10 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:10 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:10 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Deleted volume successfully. Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-61edccea-d051-4e27-ab07-03b7edbb823f tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-f115aeb5-500f-45b2-8df7-0989634ede7c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:10 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:10 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Attempting download of a2dc80b0-7475-44e5-876d-b6c205faaf1f ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'metadata': {}}])) to volume f32645f9-e5f7-4841-9cae-d62a8b01e44b. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b78060-7650-49e0-9e19-2a2117c75989]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc80b0-7475-44e5-876d-b6c205faaf1f_akhc4w4k {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:11 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc80b0-7475-44e5-876d-b6c205faaf1f_akhc4w4k Nov 05 04:06:11 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-da412f52-e37b-4051-8423-f61077bb6626-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-da412f52-e37b-4051-8423-f61077bb6626-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:11 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2dc80b0-7475-44e5-876d-b6c205faaf1f_akhc4w4k" returned: 0 in 0.418s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc80b0-7475-44e5-876d-b6c205faaf1f_akhc4w4k {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-quobyte-da412f52-e37b-4051-8423-f61077bb6626" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-da412f52-e37b-4051-8423-f61077bb6626" acquired by "delete_volume" :: waited 0.051s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b894a7e-82ae-4c14-ae3b-85de754bbb1b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:11 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc80b0-7475-44e5-876d-b6c205faaf1f_akhc4w4k Nov 05 04:06:11 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "cinder-quobyte-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e7bd05-9318-4161-b9aa-dc35947927b7]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:11 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 Nov 05 04:06:11 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:11 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef Nov 05 04:06:11 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:11 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc80b0-7475-44e5-876d-b6c205faaf1f_akhc4w4k" returned: 1 in 0.450s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2dc80b0-7475-44e5-876d-b6c205faaf1f_akhc4w4k' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ac99c-6e7c-4c10-a999-b92669dc1103]: (4, 'raw') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:12 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD Nov 05 04:06:12 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:12 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626" returned: 0 in 0.488s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:12 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626 Nov 05 04:06:12 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:12 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" returned: 0 in 0.466s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:12 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef Nov 05 04:06:12 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:12 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:12 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-da412f52-e37b-4051-8423-f61077bb6626" returned: 0 in 0.274s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-da412f52-e37b-4051-8423-f61077bb6626" released by "delete_volume" :: held 0.848s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:12 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD Nov 05 04:06:12 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created reservations ['4f5d360a-3b43-4f8a-9eac-567e3036b253', 'b0e87cef-db9a-4f15-9b3c-e005d2fc18b1', '38bd01ea-3f5b-4abf-b187-c49035332dc7', 'ed2e711d-a139-4b5c-ace3-c04cfe6d7bb7'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:12 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" returned: 0 in 0.310s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-quobyte-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef" released by "delete_volume" :: held 0.889s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Created reservations ['3e6d1886-e010-4180-8f29-f5c8d6893bdc', '161fc3b6-d7f0-413d-9910-b86774e33ab2', 'ddafdfae-07c6-4254-8a5e-3088e49dbfc5', '5cc0bc2b-4b0f-4f0e-a880-d0eddfb98878'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:12 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:12 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:12 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] a2dc80b0-7475-44e5-876d-b6c205faaf1f was raw, converting to qcow2 {{(pid=87111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:12 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b Nov 05 04:06:12 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:12 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:12 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:13 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.327s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Deleted volume successfully. Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c5502ce3-d08a-4a28-9bed-5eba4815c784 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-da412f52-e37b-4051-8423-f61077bb6626-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:13 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.285s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:13 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Deleted volume successfully. Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39df3af9-6a6e-4a6b-9742-44e30261d876 tempest-CreateVolumesFromSnapshotTest-1716138772 None] Lock "cinder-67f00d26-a9b4-40f8-a1ba-e547ccdf23ef-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:13 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b" returned: 0 in 0.567s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a2dc80b0-7475-44e5-876d-b6c205faaf1f_vtrhzrajdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:06:13 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:13 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b 1G Nov 05 04:06:13 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:13 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b 1G" returned: 0 in 0.374s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Downloaded image a2dc80b0-7475-44e5-876d-b6c205faaf1f ((None, [{'url': 'file:///opt/stack/data/glance/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'metadata': {}}])) to volume f32645f9-e5f7-4841-9cae-d62a8b01e44b successfully. {{(pid=87111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Temporary image a2dc80b0-7475-44e5-876d-b6c205faaf1f for user 8d680cd27ee14604a1a1f94567c0a06d is deleted. {{(pid=87111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.volume.volume_utils [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Marking volume f32645f9-e5f7-4841-9cae-d62a8b01e44b as bootable. {{(pid=87111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Copying metadata from image a2dc80b0-7475-44e5-876d-b6c205faaf1f to f32645f9-e5f7-4841-9cae-d62a8b01e44b. {{(pid=87111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Creating volume glance metadata for volume f32645f9-e5f7-4841-9cae-d62a8b01e44b backed by image a2dc80b0-7475-44e5-876d-b6c205faaf1f with: {'image_id': 'a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c8caa1466db1eb6741550e130555f06c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-quobyte-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1109163d-826e-40ad-bb7a-7af73ef246e3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4fb16e0-f91d-4741-8864-05e5f6d3ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b', 'volume_size': 1, 'image_id': 'a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8caa1466db1eb6741550e130555f06c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a9f24d30c8b481b891d0081c91e4b86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6675738d4d61dcdaeae0117b081bb4e7c1da2961012b013de3a11be7eaf9310596f8df978182671e35feb4f43a00c5b6312c97250c695ab97e9def1c7ee88e49', 'id': 'a2dc80b0-7475-44e5-876d-b6c205faaf1f', 'created_at': datetime.datetime(2026, 11, 5, 3, 6, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 6, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2dc80b0-7475-44e5-876d-b6c205faaf1f/file', 'properties': {}}, 'image_service': }' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ae4295-3bf0-48b1-b98b-712cf2805725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:13 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Volume volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b (f32645f9-e5f7-4841-9cae-d62a8b01e44b): created successfully Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ae4295-3bf0-48b1-b98b-712cf2805725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:13 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Flow 'volume_create_manager' (23f72d62-f579-4dbb-bcbf-2c57ef901998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5eca0f1c-5fb2-4f44-893a-d621e68cc96e tempest-VolumeImageDependencyTests-1690966906 None] Created volume successfully. Nov 05 04:06:14 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d Nov 05 04:06:14 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:14 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d" returned: 0 in 0.438s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:14 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d Nov 05 04:06:14 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:14 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d" returned: 0 in 0.304s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d" released by "delete_volume" :: held 0.819s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created reservations ['e3f75f75-33eb-403e-99b0-b498f90fbc46', 'e67eb3b8-9802-4fde-b4db-ee49486417ae', 'a562873d-65bf-4707-86c2-123a1b89ea4e', 'd96354aa-a3a4-443c-b04e-f9781c63b27f'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:15 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:15 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Flow 'volume_create_manager' (b3499f6c-fa36-42ad-8b5a-37048b3b29bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453a7329-a4fb-41ff-b4a5-881388948047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Acquiring lock "cinder-f32645f9-e5f7-4841-9cae-d62a8b01e44b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453a7329-a4fb-41ff-b4a5-881388948047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-276801875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f408cd11-7480-467c-b52c-08a5c1e98553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e1e1ee82824f0580f9ff46df4eac7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:15Z,use_quota=True,user_id='b3c9c848eb164d31a56f825707785979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8a2313-5ec1-49a7-be31-2ea01ec536b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8a2313-5ec1-49a7-be31-2ea01ec536b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377bf1d9-4ecd-4d54-adca-5b673de8f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377bf1d9-4ecd-4d54-adca-5b673de8f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f408cd11-7480-467c-b52c-08a5c1e98553', 'volume_name': 'volume-f408cd11-7480-467c-b52c-08a5c1e98553', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206167c8-3588-481c-a1d4-010747e5d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206167c8-3588-481c-a1d4-010747e5d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c70f29-2146-471c-9d90-6322c8b43867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:15 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Volume f408cd11-7480-467c-b52c-08a5c1e98553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f408cd11-7480-467c-b52c-08a5c1e98553', 'volume_size': 1} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-276801875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f408cd11-7480-467c-b52c-08a5c1e98553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e1e1ee82824f0580f9ff46df4eac7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:15Z,use_quota=True,user_id='b3c9c848eb164d31a56f825707785979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Creating volume f408cd11-7480-467c-b52c-08a5c1e98553 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:15 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:15 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 1073741824 Nov 05 04:06:15 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Lock "cinder-f32645f9-e5f7-4841-9cae-d62a8b01e44b-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Acquiring lock "cinder-quobyte-f32645f9-e5f7-4841-9cae-d62a8b01e44b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Lock "cinder-quobyte-f32645f9-e5f7-4841-9cae-d62a8b01e44b" acquired by "delete_volume" :: waited 0.101s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:15 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:15 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:15 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.426s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Deleted volume successfully. Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7b4aa7-a94c-4e1d-8a23-f0c2c6f77ebf]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-39d00b2e-78bb-465b-b1ee-ec27eb924a41 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-9cde05d0-9096-4e4e-8f6d-21f8a7a74f4d-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:15 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b Nov 05 04:06:15 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:15 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.371s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:06:15 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 1073741824" returned: 0 in 0.709s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:15 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 Nov 05 04:06:15 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-74344e77-92c5-4740-98c7-6262d306f358-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:16 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b" returned: 0 in 0.574s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-74344e77-92c5-4740-98c7-6262d306f358-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:16 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b Nov 05 04:06:16 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-quobyte-74344e77-92c5-4740-98c7-6262d306f358" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-74344e77-92c5-4740-98c7-6262d306f358" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d748b-1084-4a48-b37f-1cbde6cc2fc2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:16 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 Nov 05 04:06:16 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:16 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553" returned: 0 in 0.400s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c70f29-2146-471c-9d90-6322c8b43867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f408cd11-7480-467c-b52c-08a5c1e98553', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30c5c76-2f1c-4599-99ce-5eca2e9a25dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:16 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f32645f9-e5f7-4841-9cae-d62a8b01e44b" returned: 0 in 0.322s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:16 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Volume volume-f408cd11-7480-467c-b52c-08a5c1e98553 (f408cd11-7480-467c-b52c-08a5c1e98553): created successfully Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30c5c76-2f1c-4599-99ce-5eca2e9a25dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Flow 'volume_create_manager' (b3499f6c-fa36-42ad-8b5a-37048b3b29bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Lock "cinder-quobyte-f32645f9-e5f7-4841-9cae-d62a8b01e44b" released by "delete_volume" :: held 0.996s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:16 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a75a0fa7-1a09-47ef-a7e7-c6cedf04c3ba tempest-ProjectReaderTests-1446095443 None] Created volume successfully. Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Created reservations ['3b81f03b-d304-4278-883b-4d82dad4b59c', '78c0dda0-8a65-45b6-a484-b57ab1dd71e3', '3636b57d-a3f7-4fb3-b97c-f3383e256f3e', '79bae5aa-39d1-46f1-991d-0350e6696ec1'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:16 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:16 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:16 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358" returned: 0 in 0.436s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:16 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358 Nov 05 04:06:16 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:16 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.291s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:16 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Deleted volume successfully. Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f878cd11-b7d5-4876-8e3a-4f40a2cea163 tempest-VolumeImageDependencyTests-1690966906 None] Lock "cinder-f32645f9-e5f7-4841-9cae-d62a8b01e44b-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:16 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-74344e77-92c5-4740-98c7-6262d306f358" returned: 0 in 0.306s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-74344e77-92c5-4740-98c7-6262d306f358" released by "delete_volume" :: held 0.798s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:16 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created reservations ['0cb4ce18-865d-4d23-bf77-7871c1b3f07f', '773d460d-b65b-4e3e-a80a-98d56babe937', 'b7fad261-b52a-4385-8915-043b12d3dd3d', 'b3d2d8e1-3941-41c6-9226-a1178a99c672'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:17 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:17 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-fda06369-33cd-4bb2-9d94-2410904f40dc-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-fda06369-33cd-4bb2-9d94-2410904f40dc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Acquiring lock "cinder-f408cd11-7480-467c-b52c-08a5c1e98553-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Lock "cinder-f408cd11-7480-467c-b52c-08a5c1e98553-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "cinder-quobyte-fda06369-33cd-4bb2-9d94-2410904f40dc" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-fda06369-33cd-4bb2-9d94-2410904f40dc" acquired by "delete_volume" :: waited 0.041s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Acquiring lock "cinder-quobyte-f408cd11-7480-467c-b52c-08a5c1e98553" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f59aa9-1428-4bdd-a001-868396d8476e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:17 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.420s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Lock "cinder-quobyte-f408cd11-7480-467c-b52c-08a5c1e98553" acquired by "delete_volume" :: waited 0.040s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Deleted volume successfully. Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d0ab9a8b-0fdb-4873-9a4b-03a51b0713d6 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-74344e77-92c5-4740-98c7-6262d306f358-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec53363-ee42-426d-8821-7307f0b13e99]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:17 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc Nov 05 04:06:17 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:17 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 Nov 05 04:06:17 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-69af1e06-d6f4-44f1-bf64-a36fbad6b894 tempest-ProjectAdminTests-1729302262 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87111) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Nov 05 04:06:17 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc" returned: 0 in 0.456s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:17 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc Nov 05 04:06:17 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:18 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553" returned: 0 in 0.510s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:18 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553 Nov 05 04:06:18 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:18 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-fda06369-33cd-4bb2-9d94-2410904f40dc" returned: 0 in 0.292s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-quobyte-fda06369-33cd-4bb2-9d94-2410904f40dc" released by "delete_volume" :: held 0.816s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Created reservations ['44fa5c3a-f343-4566-a6e5-e73b18f901f1', 'd8002fa6-1aa4-4ade-b849-143016cd33cb', '6d36ab73-49bf-4cb9-9362-2be5137797d0', '95160f14-3ea7-4aa4-aac7-18e1db41be0a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:18 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f408cd11-7480-467c-b52c-08a5c1e98553" returned: 0 in 0.332s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Lock "cinder-quobyte-f408cd11-7480-467c-b52c-08a5c1e98553" released by "delete_volume" :: held 0.921s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:18 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:18 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Created reservations ['85075f38-f21e-4367-93e3-bdb5837f60fa', 'd8864e28-5622-4dd0-a27d-02d675b16cb1', 'cd9eafc0-695e-4269-b23e-1923b324d925', '64afa213-6a96-4268-8c0d-e1c503b807d4'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:18 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:18 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:18 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.378s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Deleted volume successfully. Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d45832ac-a8d7-459c-88b7-9afcf31aa700 tempest-CreateVolumesFromSourceVolumeTest-97018760 None] Lock "cinder-fda06369-33cd-4bb2-9d94-2410904f40dc-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:18 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.327s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Deleted volume successfully. Nov 05 04:06:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7be974db-141d-44ce-b1a6-5c5dea7debaa tempest-ProjectReaderTests-1446095443 None] Lock "cinder-f408cd11-7480-467c-b52c-08a5c1e98553-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Flow 'volume_create_manager' (f5e45fda-c294-43f3-bfdd-6d2c59adda5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1513c494-8fc8-4657-b96d-52a71ccfa6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1513c494-8fc8-4657-b96d-52a71ccfa6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937641315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209a63b0-4f8b-4f02-aaad-65d23cda50fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e1e1ee82824f0580f9ff46df4eac7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:20Z,use_quota=True,user_id='b3c9c848eb164d31a56f825707785979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9fd8bd-5ba5-480f-bc74-19cbcb720ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9fd8bd-5ba5-480f-bc74-19cbcb720ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41ee46c-059b-46d9-a3c0-371b6333ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41ee46c-059b-46d9-a3c0-371b6333ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209a63b0-4f8b-4f02-aaad-65d23cda50fc', 'volume_name': 'volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8c93aa-3a92-40cb-b5d4-aae4870b8063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8c93aa-3a92-40cb-b5d4-aae4870b8063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f046d8f8-ea0d-4885-8c08-ab0f50d90de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Volume 209a63b0-4f8b-4f02-aaad-65d23cda50fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc', 'volume_size': 1} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937641315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209a63b0-4f8b-4f02-aaad-65d23cda50fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e1e1ee82824f0580f9ff46df4eac7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:20Z,use_quota=True,user_id='b3c9c848eb164d31a56f825707785979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Creating volume 209a63b0-4f8b-4f02-aaad-65d23cda50fc {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:20 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:20 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc 1073741824 Nov 05 04:06:20 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:20 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc 1073741824" returned: 0 in 0.552s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:21 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc Nov 05 04:06:21 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:21 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc" returned: 0 in 0.255s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f046d8f8-ea0d-4885-8c08-ab0f50d90de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53b7c1d-bcfb-41a8-8895-e520523931a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:21 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Volume volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc (209a63b0-4f8b-4f02-aaad-65d23cda50fc): created successfully Nov 05 04:06:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53b7c1d-bcfb-41a8-8895-e520523931a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Flow 'volume_create_manager' (f5e45fda-c294-43f3-bfdd-6d2c59adda5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:21 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b00f4283-af19-4fa6-8efd-1e134968ef59 tempest-ProjectReaderTests-1446095443 None] Created volume successfully. Nov 05 04:06:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Acquiring lock "cinder-209a63b0-4f8b-4f02-aaad-65d23cda50fc-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Lock "cinder-209a63b0-4f8b-4f02-aaad-65d23cda50fc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Acquiring lock "cinder-quobyte-209a63b0-4f8b-4f02-aaad-65d23cda50fc" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Lock "cinder-quobyte-209a63b0-4f8b-4f02-aaad-65d23cda50fc" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:22 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8865e3-1ed4-4acd-8e16-b554306f553e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:22 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc Nov 05 04:06:22 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Flow 'volume_create_manager' (e7bebf2b-f2d0-4577-8948-707a1ea52207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52cf84fd-7c1b-45a7-9674-ba266cf4b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52cf84fd-7c1b-45a7-9674-ba266cf4b603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1015388213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af52c0b8-6696-4890-ad32-9b796a78cac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b128c7c3c7411693e9056e0297ecba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:23Z,use_quota=True,user_id='cf4c8e60152a4871b335087516470f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2665095-9ecb-4731-9958-f192b5cf2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2665095-9ecb-4731-9958-f192b5cf2f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa994950-5c83-47c7-a185-f5876e1d3314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa994950-5c83-47c7-a185-f5876e1d3314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af52c0b8-6696-4890-ad32-9b796a78cac2', 'volume_name': 'volume-af52c0b8-6696-4890-ad32-9b796a78cac2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a44c34b-d49a-46f0-ad21-09ccdcdb23c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a44c34b-d49a-46f0-ad21-09ccdcdb23c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931aea7e-db69-481c-bf1e-20251c7ea9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:23 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Volume af52c0b8-6696-4890-ad32-9b796a78cac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af52c0b8-6696-4890-ad32-9b796a78cac2', 'volume_size': 1} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1015388213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af52c0b8-6696-4890-ad32-9b796a78cac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b128c7c3c7411693e9056e0297ecba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:23Z,use_quota=True,user_id='cf4c8e60152a4871b335087516470f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Creating volume af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:23 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:23 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc" returned: 0 in 0.527s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:23 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 1073741824 Nov 05 04:06:23 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:23 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc Nov 05 04:06:23 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:23 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-209a63b0-4f8b-4f02-aaad-65d23cda50fc" returned: 0 in 0.330s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Lock "cinder-quobyte-209a63b0-4f8b-4f02-aaad-65d23cda50fc" released by "delete_volume" :: held 0.927s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Created reservations ['65452ecb-31e4-4cf2-829a-6d83357a7829', '3f749b3a-d9f5-4d60-a355-3a31a7f94dba', '100854a0-cd2f-4bc9-90c2-4a78993381d9', 'ca92eff6-d995-43d9-bedd-9bc91bce9056'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:23 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 1073741824" returned: 0 in 0.583s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:23 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:23 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:23 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 Nov 05 04:06:23 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:24 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Deleted volume successfully. Nov 05 04:06:24 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2" returned: 0 in 0.332s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931aea7e-db69-481c-bf1e-20251c7ea9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af52c0b8-6696-4890-ad32-9b796a78cac2', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8adaac3-c6a9-4566-b34d-5562a735b322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-4603303b-d2cc-4f83-90a9-89e6b1c32095 tempest-ProjectReaderTests-1446095443 None] Lock "cinder-209a63b0-4f8b-4f02-aaad-65d23cda50fc-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Volume volume-af52c0b8-6696-4890-ad32-9b796a78cac2 (af52c0b8-6696-4890-ad32-9b796a78cac2): created successfully Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8adaac3-c6a9-4566-b34d-5562a735b322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Flow 'volume_create_manager' (e7bebf2b-f2d0-4577-8948-707a1ea52207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3bdf7eba-7d9b-4eac-95b3-0fd0d0765d36 tempest-VolumeDependencyTests-1336400367 None] Created volume successfully. Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (ccf44b8b-5d0b-4e25-819b-e256a95f404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a76c28-f744-4b75-bf3a-c2def09534c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a76c28-f744-4b75-bf3a-c2def09534c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852680701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb39eeb-85da-4b5d-925a-07337d54f953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:24Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fb3c6e-96a0-4ba7-b61a-2608d84011dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fb3c6e-96a0-4ba7-b61a-2608d84011dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b818f131-1ee9-4a81-9314-7f28d9a60a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b818f131-1ee9-4a81-9314-7f28d9a60a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb39eeb-85da-4b5d-925a-07337d54f953', 'volume_name': 'volume-5fb39eeb-85da-4b5d-925a-07337d54f953', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eff7c67-2ae8-424d-9676-e7257dfaa09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eff7c67-2ae8-424d-9676-e7257dfaa09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29dd5e1f-69de-488b-80f2-17a802656397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Volume 5fb39eeb-85da-4b5d-925a-07337d54f953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb39eeb-85da-4b5d-925a-07337d54f953', 'volume_size': 1} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852680701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb39eeb-85da-4b5d-925a-07337d54f953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:24Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Creating volume 5fb39eeb-85da-4b5d-925a-07337d54f953 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:24 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:24 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 1073741824 Nov 05 04:06:24 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:24 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 1073741824" returned: 0 in 0.544s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:25 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 Nov 05 04:06:25 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:25 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29dd5e1f-69de-488b-80f2-17a802656397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb39eeb-85da-4b5d-925a-07337d54f953', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bccd8e-58d5-4995-973a-9e7ea2e4bdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:25 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Volume volume-5fb39eeb-85da-4b5d-925a-07337d54f953 (5fb39eeb-85da-4b5d-925a-07337d54f953): created successfully Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bccd8e-58d5-4995-973a-9e7ea2e4bdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (ccf44b8b-5d0b-4e25-819b-e256a95f404c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:25 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-09f7a566-ce30-41c7-a327-67aa10e70303 tempest-ProjectReaderTests-1624626791 None] Created volume successfully. Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Creating offline snapshot c5323208-1f74-42d1-a1af-e9536ef56c1d of volume af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f07c8ed-3bfd-4601-bbab-31a175da0ef7]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:25 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 Nov 05 04:06:25 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:25 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2" returned: 0 in 0.428s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:25 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d 1G Nov 05 04:06:26 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:26 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d 1G" returned: 0 in 0.568s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af52c0b8-6696-4890-ad32-9b796a78cac2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:26 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af52c0b8-6696-4890-ad32-9b796a78cac2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d Nov 05 04:06:26 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:26 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af52c0b8-6696-4890-ad32-9b796a78cac2 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d" returned: 0 in 0.324s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:26 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d is being set with open permissions: ugo+rw Nov 05 04:06:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:26 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d Nov 05 04:06:26 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:27 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d" returned: 0 in 0.264s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:27 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.info Nov 05 04:06:27 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:27 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.info" returned: 0 in 0.268s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:27 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.info is being set with open permissions: ugo+rw Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:27 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.info Nov 05 04:06:27 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:27 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.info" returned: 0 in 0.270s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.242s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Creating offline snapshot 7fb2771d-36a0-482b-925e-ddae2993ae5d of volume 5fb39eeb-85da-4b5d-925a-07337d54f953 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:06:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b9d9e104-a3dc-480f-80d5-a15b4b8346cb tempest-VolumeDependencyTests-1336400367 None] Create snapshot completed successfully Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d777e0-df91-4b2b-b330-97252cfc95c9]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:27 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 Nov 05 04:06:27 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:28 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953" returned: 0 in 0.435s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:28 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d 1G Nov 05 04:06:28 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (bc2e8c2e-e3ca-4bc9-936c-8d25f196e5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637b8f2a-7cd4-4079-b6f3-39425bdefe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637b8f2a-7cd4-4079-b6f3-39425bdefe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990043573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06aac625-0bba-4a59-b54e-362df3df9feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:28Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5707ba-9d76-4859-b448-539d98958634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5707ba-9d76-4859-b448-539d98958634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1428106d-e5d4-4b13-bb07-0199c1884392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1428106d-e5d4-4b13-bb07-0199c1884392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06aac625-0bba-4a59-b54e-362df3df9feb', 'volume_name': 'volume-06aac625-0bba-4a59-b54e-362df3df9feb', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d166fc-dce9-4b2e-8925-7179ad1a7553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d166fc-dce9-4b2e-8925-7179ad1a7553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8b71b1-a8e0-4cd2-a524-ef439a615829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:28 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Volume 06aac625-0bba-4a59-b54e-362df3df9feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06aac625-0bba-4a59-b54e-362df3df9feb', 'volume_size': 1} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:28 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d 1G" returned: 0 in 0.529s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb39eeb-85da-4b5d-925a-07337d54f953 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:28 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb39eeb-85da-4b5d-925a-07337d54f953 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d Nov 05 04:06:28 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:29 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb39eeb-85da-4b5d-925a-07337d54f953 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d" returned: 0 in 0.340s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:29 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d is being set with open permissions: ugo+rw Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:29 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d Nov 05 04:06:29 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Flow 'volume_create_manager' (09bbf90c-1455-449a-a116-9e52704cbf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0e5e50-3798-477b-b632-bd3b492b97ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:29 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0e5e50-3798-477b-b632-bd3b492b97ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998893088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92805cd4-2e38-498e-b2b0-558089d7a95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b128c7c3c7411693e9056e0297ecba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5323208-1f74-42d1-a1af-e9536ef56c1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:29Z,use_quota=True,user_id='cf4c8e60152a4871b335087516470f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df089e65-1690-414f-bd94-3d77ac44e3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df089e65-1690-414f-bd94-3d77ac44e3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acec96b4-4c69-4c78-9875-6ee6efe05cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acec96b4-4c69-4c78-9875-6ee6efe05cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '92805cd4-2e38-498e-b2b0-558089d7a95b', 'volume_name': 'volume-92805cd4-2e38-498e-b2b0-558089d7a95b', 'volume_size': 1, 'snapshot_id': 'c5323208-1f74-42d1-a1af-e9536ef56c1d'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6792c7e8-4afd-4a8b-8ad3-2046c2696e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6792c7e8-4afd-4a8b-8ad3-2046c2696e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97cc64c2-149f-489a-b4f4-ffb9d89959b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Volume 92805cd4-2e38-498e-b2b0-558089d7a95b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-92805cd4-2e38-498e-b2b0-558089d7a95b', 'volume_size': 1, 'snapshot_id': 'c5323208-1f74-42d1-a1af-e9536ef56c1d'} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:29 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.info Nov 05 04:06:29 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:29 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.info" returned: 0 in 0.272s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:29 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.info is being set with open permissions: ugo+rw Nov 05 04:06:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:29 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.info Nov 05 04:06:29 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:30 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.info" returned: 0 in 0.280s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990043573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06aac625-0bba-4a59-b54e-362df3df9feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:28Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Creating volume 06aac625-0bba-4a59-b54e-362df3df9feb {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:30 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:30 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb 1073741824 Nov 05 04:06:30 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9153b1ae-a8f1-4c98-b68c-65e50c06df65 tempest-ProjectReaderTests-1624626791 None] Create snapshot completed successfully Nov 05 04:06:30 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb 1073741824" returned: 0 in 0.483s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:30 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb Nov 05 04:06:30 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-7fb2771d-36a0-482b-925e-ddae2993ae5d-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:30 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb" returned: 0 in 0.302s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.473s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-quobyte-c5323208-1f74-42d1-a1af-e9536ef56c1d-92805cd4-2e38-498e-b2b0-558089d7a95b" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8b71b1-a8e0-4cd2-a524-ef439a615829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06aac625-0bba-4a59-b54e-362df3df9feb', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1863b424-f591-46c6-af28-519f76732de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Lock "cinder-7fb2771d-36a0-482b-925e-ddae2993ae5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-5fb39eeb-85da-4b5d-925a-07337d54f953" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-c5323208-1f74-42d1-a1af-e9536ef56c1d-92805cd4-2e38-498e-b2b0-558089d7a95b" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Creating volume 92805cd4-2e38-498e-b2b0-558089d7a95b from snapshot c5323208-1f74-42d1-a1af-e9536ef56c1d {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-quobyte-92805cd4-2e38-498e-b2b0-558089d7a95b" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:30 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Volume volume-06aac625-0bba-4a59-b54e-362df3df9feb (06aac625-0bba-4a59-b54e-362df3df9feb): created successfully Nov 05 04:06:30 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1863b424-f591-46c6-af28-519f76732de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (bc2e8c2e-e3ca-4bc9-936c-8d25f196e5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-5fb39eeb-85da-4b5d-925a-07337d54f953" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-7fb2771d-36a0-482b-925e-ddae2993ae5d" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-92805cd4-2e38-498e-b2b0-558089d7a95b" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] snapshot: c5323208-1f74-42d1-a1af-e9536ef56c1d, volume: 92805cd4-2e38-498e-b2b0-558089d7a95b, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-7fb2771d-36a0-482b-925e-ddae2993ae5d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Deleting offline snapshot 7fb2771d-36a0-482b-925e-ddae2993ae5d of volume 5fb39eeb-85da-4b5d-925a-07337d54f953 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] snapshot_file for this snap is: volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:06:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2acde6bc-adcf-4472-b381-c1bf4d879600 tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3ecec-6c0d-4134-ac14-fd4f1e32a66d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e1b611-85c9-4547-a23e-0de325f40245]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:31 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d Nov 05 04:06:31 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:31 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d Nov 05 04:06:31 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:31 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d" returned: 0 in 0.402s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb39eeb-85da-4b5d-925a-07337d54f953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd734ccc-67da-47aa-a2aa-62140d9e2826]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:31 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d" returned: 0 in 0.453s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af52c0b8-6696-4890-ad32-9b796a78cac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fa20bc-15ba-4773-ab99-7575aa89bf96]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:31 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 Nov 05 04:06:31 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:31 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 Nov 05 04:06:31 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:32 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953" returned: 0 in 0.453s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:32 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d Nov 05 04:06:32 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:32 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2" returned: 0 in 0.518s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:32 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b Nov 05 04:06:32 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:32 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d" returned: 0 in 0.482s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:32 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d Nov 05 04:06:32 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:32 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953.7fb2771d-36a0-482b-925e-ddae2993ae5d" returned: 0 in 0.311s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-7fb2771d-36a0-482b-925e-ddae2993ae5d" released by "_delete_snapshot" :: held 1.886s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-5fb39eeb-85da-4b5d-925a-07337d54f953" released by "delete_snapshot" :: held 1.923s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=228,cinder:UPDATE=300,cinder:DELETE=19,cinder:INSERT=67 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:06:32 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=266,cinder:SELECT=230,cinder:INSERT=82,cinder:DELETE=34 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:06:33 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Created reservations ['eaf6008d-6168-4df6-baeb-ec8a42a9be4f', '92d25b59-7eb7-45d2-8db0-0ff0066b003e', '857d8777-d3ce-4295-9502-fec851db52f1', '526266a1-300a-44f6-adaa-496e61fc3337'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:33 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Delete snapshot completed successfully. Nov 05 04:06:33 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-16cce2e5-2adf-4048-8f01-cbe1e9326afd tempest-ProjectReaderTests-1624626791 None] Lock "cinder-7fb2771d-36a0-482b-925e-ddae2993ae5d-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-5fb39eeb-85da-4b5d-925a-07337d54f953-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-5fb39eeb-85da-4b5d-925a-07337d54f953-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-5fb39eeb-85da-4b5d-925a-07337d54f953" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-5fb39eeb-85da-4b5d-925a-07337d54f953" acquired by "delete_volume" :: waited 0.028s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:34 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03e1d57-7a85-4654-90ec-bd0eb66e582f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:34 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 Nov 05 04:06:34 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:35 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953" returned: 0 in 0.783s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:35 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953 Nov 05 04:06:35 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:35 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-5fb39eeb-85da-4b5d-925a-07337d54f953" returned: 0 in 0.485s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-5fb39eeb-85da-4b5d-925a-07337d54f953" released by "delete_volume" :: held 1.419s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:35 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Created reservations ['e5c06340-ff21-4b12-aa82-657fc5c776bd', '0aa5f6ff-7f20-4f4c-a999-99b059683821', 'e4278a0b-6edd-4ba7-98f6-2a20936f548c', 'fef0a61d-a081-4836-ae1a-345ef01a60f3'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:36 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:36 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:36 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.546s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:36 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Deleted volume successfully. Nov 05 04:06:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc67e300-f4d6-41de-9a16-44f97d115bf4 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-5fb39eeb-85da-4b5d-925a-07337d54f953-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (0b499ffa-28c9-4e91-9533-d77d941d2fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcbe168-6e76-4923-8aed-b13abc9ba68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcbe168-6e76-4923-8aed-b13abc9ba68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218926028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0799e0-8b07-4ff5-9eca-24d7c54eafb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:37Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8675773-63c9-434c-a1c9-da48515ce7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8675773-63c9-434c-a1c9-da48515ce7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6a48f5-d5dd-43af-ab67-afd2162f5108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6a48f5-d5dd-43af-ab67-afd2162f5108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0799e0-8b07-4ff5-9eca-24d7c54eafb8', 'volume_name': 'volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279efb58-289e-44bd-aa20-5c334c4c228b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279efb58-289e-44bd-aa20-5c334c4c228b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655ab3a6-5a5a-424d-8ec9-1910c66e9316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:37 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Volume 1f0799e0-8b07-4ff5-9eca-24d7c54eafb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8', 'volume_size': 1} Nov 05 04:06:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:40 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b" returned: 0 in 8.216s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2, size 1024.00 MB, duration 8.22 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:06:40 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Converted 1024.00 MB image at 124.62 MB/s Nov 05 04:06:40 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b is being set with open permissions: ugo+rw Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:40 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b Nov 05 04:06:40 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:40 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b" returned: 0 in 0.284s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-92805cd4-2e38-498e-b2b0-558089d7a95b" released by "_copy_volume_from_snapshot" :: held 9.632s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-c5323208-1f74-42d1-a1af-e9536ef56c1d-92805cd4-2e38-498e-b2b0-558089d7a95b" released by "_create_volume_from_snapshot" :: held 9.736s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.793s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.809s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Creating offline snapshot ca6b36c1-936e-47ba-a963-681c5593952c of volume 06aac625-0bba-4a59-b54e-362df3df9feb {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97cc64c2-149f-489a-b4f4-ffb9d89959b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92805cd4-2e38-498e-b2b0-558089d7a95b', 'volume_size': 1, 'snapshot_id': 'c5323208-1f74-42d1-a1af-e9536ef56c1d'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47fada4-418e-40f0-8f81-06daa1a4db53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e53aa1-73db-4ca9-a879-be1fa6fd47ab]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:40 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Volume volume-92805cd4-2e38-498e-b2b0-558089d7a95b (92805cd4-2e38-498e-b2b0-558089d7a95b): created successfully Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47fada4-418e-40f0-8f81-06daa1a4db53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:40 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Flow 'volume_create_manager' (09bbf90c-1455-449a-a116-9e52704cbf1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:40 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-14b5d022-a349-4d71-8c24-01e21b1ef321 tempest-VolumeDependencyTests-1336400367 None] Created volume successfully. Nov 05 04:06:40 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb Nov 05 04:06:40 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:41 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb" returned: 0 in 0.534s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:41 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c 1G Nov 05 04:06:41 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-c5323208-1f74-42d1-a1af-e9536ef56c1d-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-c5323208-1f74-42d1-a1af-e9536ef56c1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-quobyte-af52c0b8-6696-4890-ad32-9b796a78cac2" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-af52c0b8-6696-4890-ad32-9b796a78cac2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-quobyte-c5323208-1f74-42d1-a1af-e9536ef56c1d" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-c5323208-1f74-42d1-a1af-e9536ef56c1d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Deleting offline snapshot c5323208-1f74-42d1-a1af-e9536ef56c1d of volume af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] snapshot_file for this snap is: volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a252381c-dd58-4685-974d-3dc780b929d6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:41 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d Nov 05 04:06:41 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:41 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c 1G" returned: 0 in 0.600s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06aac625-0bba-4a59-b54e-362df3df9feb -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:41 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06aac625-0bba-4a59-b54e-362df3df9feb -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c Nov 05 04:06:41 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:42 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d" returned: 0 in 0.432s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af52c0b8-6696-4890-ad32-9b796a78cac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05e2c78-c9ef-4fef-bd55-64f33e7715dc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:42 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 Nov 05 04:06:42 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:42 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06aac625-0bba-4a59-b54e-362df3df9feb -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c" returned: 0 in 0.323s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:42 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c is being set with open permissions: ugo+rw Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:42 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c Nov 05 04:06:42 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:42 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c" returned: 0 in 0.266s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:42 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.info Nov 05 04:06:42 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:42 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2" returned: 0 in 0.597s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:42 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d Nov 05 04:06:42 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:42 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.info" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:42 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.info is being set with open permissions: ugo+rw Nov 05 04:06:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:42 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.info Nov 05 04:06:42 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:43 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d" returned: 0 in 0.398s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:43 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d Nov 05 04:06:43 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:43 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.info" returned: 0 in 0.277s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.494s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218926028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0799e0-8b07-4ff5-9eca-24d7c54eafb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:37Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Creating volume 1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:43 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:43 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 1073741824 Nov 05 04:06:43 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:43 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-20a04102-83a0-4381-83d0-f2ce734e728a tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:06:43 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2.c5323208-1f74-42d1-a1af-e9536ef56c1d" returned: 0 in 0.272s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-c5323208-1f74-42d1-a1af-e9536ef56c1d" released by "_delete_snapshot" :: held 1.848s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-af52c0b8-6696-4890-ad32-9b796a78cac2" released by "delete_snapshot" :: held 1.883s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Created reservations ['87426109-39f1-443b-b763-ad9306460f68', 'efbd8e15-5b42-4482-b42e-95f3fb941e3a', 'f9f58790-97bf-4eb2-a4ef-a4e00fb37fc3', '21953b69-cdff-4b32-8138-d06d6e495499'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:43 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Delete snapshot completed successfully. Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-ca6b36c1-936e-47ba-a963-681c5593952c-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-cef908b2-b7ec-4dc5-9000-9512025addc0 tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-c5323208-1f74-42d1-a1af-e9536ef56c1d-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-ca6b36c1-936e-47ba-a963-681c5593952c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-06aac625-0bba-4a59-b54e-362df3df9feb" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-06aac625-0bba-4a59-b54e-362df3df9feb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-ca6b36c1-936e-47ba-a963-681c5593952c" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-ca6b36c1-936e-47ba-a963-681c5593952c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot ca6b36c1-936e-47ba-a963-681c5593952c of volume 06aac625-0bba-4a59-b54e-362df3df9feb {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[91019582-70ec-45ef-83f4-69865955cbe6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-af52c0b8-6696-4890-ad32-9b796a78cac2-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-af52c0b8-6696-4890-ad32-9b796a78cac2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:43 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c Nov 05 04:06:43 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-quobyte-af52c0b8-6696-4890-ad32-9b796a78cac2" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:43 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 1073741824" returned: 0 in 0.707s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-af52c0b8-6696-4890-ad32-9b796a78cac2" acquired by "delete_volume" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1bf8fa-24d0-419a-a24f-878cb77d6497]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:44 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 Nov 05 04:06:44 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:44 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 Nov 05 04:06:44 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:44 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c" returned: 0 in 0.521s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06aac625-0bba-4a59-b54e-362df3df9feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33cdeea-320c-48df-959a-62902b4d9be6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:44 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655ab3a6-5a5a-424d-8ec9-1910c66e9316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ede1a86-250a-4ad2-8608-bf44f66a23a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:44 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Volume volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 (1f0799e0-8b07-4ff5-9eca-24d7c54eafb8): created successfully Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ede1a86-250a-4ad2-8608-bf44f66a23a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (0b499ffa-28c9-4e91-9533-d77d941d2fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:44 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-535a3e24-b907-4c93-983c-b9847506d394 tempest-ProjectReaderTests-1624626791 None] Created volume successfully. Nov 05 04:06:44 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb Nov 05 04:06:44 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:44 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:44 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2 Nov 05 04:06:44 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:44 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb" returned: 0 in 0.392s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:44 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-af52c0b8-6696-4890-ad32-9b796a78cac2" returned: 0 in 0.273s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:44 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c Nov 05 04:06:44 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-af52c0b8-6696-4890-ad32-9b796a78cac2" released by "delete_volume" :: held 0.775s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Created reservations ['03397ac3-ac08-42d5-9cad-cf8a5900bfe2', '9161240e-cf31-4be3-8cb2-e74c9ab12b92', '3e04cd32-f61a-4393-94fd-82ccdd27d464', 'be24a503-78c9-4969-be72-4b6eafe6c2f0'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:44 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:44 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-92805cd4-2e38-498e-b2b0-558089d7a95b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-92805cd4-2e38-498e-b2b0-558089d7a95b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "cinder-quobyte-92805cd4-2e38-498e-b2b0-558089d7a95b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:45 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c" returned: 0 in 0.505s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-92805cd4-2e38-498e-b2b0-558089d7a95b" acquired by "delete_volume" :: waited 0.067s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:45 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c Nov 05 04:06:45 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:45 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.368s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ef640-5aa1-4f9c-994f-9ea153525f6a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:45 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Deleted volume successfully. Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f3673836-642c-4cc3-9932-29a1724372ca tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-af52c0b8-6696-4890-ad32-9b796a78cac2-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Creating offline snapshot ba750a44-0669-45e8-8be2-ebb46b01c078 of volume 1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:06:45 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b Nov 05 04:06:45 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb057ac0-beff-4bcd-8702-5fb72b5b945a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:45 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb.ca6b36c1-936e-47ba-a963-681c5593952c" returned: 0 in 0.380s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:45 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 Nov 05 04:06:45 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-ca6b36c1-936e-47ba-a963-681c5593952c" released by "_delete_snapshot" :: held 1.948s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-06aac625-0bba-4a59-b54e-362df3df9feb" released by "delete_snapshot" :: held 1.986s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:45 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b" returned: 0 in 0.456s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Created reservations ['df63b76a-514b-4a46-a14d-0cc7b1fceaac', 'b076beb8-fac2-484b-bfcb-570620c628be', '93908b21-b085-4c8c-bff8-3c1ce46b8316', 'b9b1a73f-a681-4717-bc5f-28c88db0c467'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:45 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b Nov 05 04:06:45 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:45 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-501b0362-9187-4fe3-adfb-6750103941c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-ca6b36c1-936e-47ba-a963-681c5593952c-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:45 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" returned: 0 in 0.502s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:45 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 1G Nov 05 04:06:45 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:46 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-92805cd4-2e38-498e-b2b0-558089d7a95b" returned: 0 in 0.315s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-quobyte-92805cd4-2e38-498e-b2b0-558089d7a95b" released by "delete_volume" :: held 0.836s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Created reservations ['dd6179f1-eb86-469f-9535-5dcba931f767', '4bada057-660c-470f-b56e-3347c4e0d958', '68046822-e0b9-4556-83f6-819e82e47955', '4ae4f814-e46a-47f1-879f-22fd1278ec1a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:46 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:46 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:46 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 1G" returned: 0 in 0.577s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:46 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 Nov 05 04:06:46 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:46 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.377s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:46 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Deleted volume successfully. Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7a38ea9-9b7e-4698-bba6-d42f70b7855d tempest-VolumeDependencyTests-1336400367 None] Lock "cinder-92805cd4-2e38-498e-b2b0-558089d7a95b-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-06aac625-0bba-4a59-b54e-362df3df9feb-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Lock "cinder-06aac625-0bba-4a59-b54e-362df3df9feb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:46 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078" returned: 0 in 0.394s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:46 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 is being set with open permissions: ugo+rw Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-06aac625-0bba-4a59-b54e-362df3df9feb" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:46 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 Nov 05 04:06:46 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-06aac625-0bba-4a59-b54e-362df3df9feb" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74fdf1c-9724-4288-85ab-adf113889227]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:47 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb Nov 05 04:06:47 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:47 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078" returned: 0 in 0.281s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:47 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.info Nov 05 04:06:47 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:47 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb" returned: 0 in 0.513s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:47 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb Nov 05 04:06:47 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:47 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.info" returned: 0 in 0.338s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:47 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.info is being set with open permissions: ugo+rw Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:47 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.info Nov 05 04:06:47 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:47 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-06aac625-0bba-4a59-b54e-362df3df9feb" returned: 0 in 0.340s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:47 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.info" returned: 0 in 0.317s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:47 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-06aac625-0bba-4a59-b54e-362df3df9feb" released by "delete_volume" :: held 0.995s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-137fbcce-8458-4856-8d45-9b7d1518635d tempest-ProjectReaderTests-1624626791 None] Create snapshot completed successfully Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Created reservations ['fc009ccf-f571-4eb1-b7d2-ee32faabb65a', '6afe3d5b-7a8a-4463-99dd-edb8eef7e233', '860b83ec-4007-444d-9b1d-aa5e52d77710', '3fcc0b41-0e89-4460-9c06-ae1472758496'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:48 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:48 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:48 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.308s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a550a282-1d29-4157-89d5-2fc95c78bc20 tempest-ProjectMemberTests-611526917 None] Lock "cinder-06aac625-0bba-4a59-b54e-362df3df9feb-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-ba750a44-0669-45e8-8be2-ebb46b01c078-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Lock "cinder-ba750a44-0669-45e8-8be2-ebb46b01c078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-ba750a44-0669-45e8-8be2-ebb46b01c078" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-ba750a44-0669-45e8-8be2-ebb46b01c078" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Deleting offline snapshot ba750a44-0669-45e8-8be2-ebb46b01c078 of volume 1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] snapshot_file for this snap is: volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[67147d41-f714-4ce7-ad23-ffa086cedb6d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:48 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 Nov 05 04:06:48 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:49 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078" returned: 0 in 0.424s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[940edfd9-d5bb-49cc-9338-c9f51ab6d209]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:49 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 Nov 05 04:06:49 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:49 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" returned: 0 in 0.447s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:49 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 Nov 05 04:06:49 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (1c11bf37-24e1-45d0-863c-bb056216db1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bce36b-a6a4-4378-a786-5df73f52e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bce36b-a6a4-4378-a786-5df73f52e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717332438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e0a62e-11f6-48c3-9af5-f112966d3ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:50Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d635da-f331-4b53-a76f-ede406956cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d635da-f331-4b53-a76f-ede406956cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea701114-8de8-4f6b-b838-72e87ba9603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea701114-8de8-4f6b-b838-72e87ba9603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e0a62e-11f6-48c3-9af5-f112966d3ab0', 'volume_name': 'volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d518cc75-7d72-4d38-9dfb-3c99219b385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d518cc75-7d72-4d38-9dfb-3c99219b385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6813e45f-4783-454f-a369-da9a9aba08d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:49 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Volume 12e0a62e-11f6-48c3-9af5-f112966d3ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0', 'volume_size': 1} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717332438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e0a62e-11f6-48c3-9af5-f112966d3ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:50Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Creating volume 12e0a62e-11f6-48c3-9af5-f112966d3ab0 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:49 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:49 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 1073741824 Nov 05 04:06:49 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:50 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078" returned: 0 in 0.482s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:50 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078 Nov 05 04:06:50 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:50 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8.ba750a44-0669-45e8-8be2-ebb46b01c078" returned: 0 in 0.306s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:50 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 1073741824" returned: 0 in 0.591s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-ba750a44-0669-45e8-8be2-ebb46b01c078" released by "_delete_snapshot" :: held 1.818s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" released by "delete_snapshot" :: held 1.852s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:50 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 Nov 05 04:06:50 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Created reservations ['99624f6c-cd72-4e2e-9c3e-9f5c6dbcc7e6', 'dc17c2af-ff00-45df-b072-b26b9cacc7e2', '4e0b0db7-fe4a-4085-850c-ff575663869f', '4ef7b348-2141-4afc-b298-1f3b098c65ba'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Delete snapshot completed successfully. Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-7b3b3ad5-30b1-46c6-8a5e-90714eaf1b8d tempest-ProjectReaderTests-1624626791 None] Lock "cinder-ba750a44-0669-45e8-8be2-ebb46b01c078-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:50 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0" returned: 0 in 0.356s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Lock "cinder-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6813e45f-4783-454f-a369-da9a9aba08d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8173215b-e4a0-4d42-9b4b-eb17bd5e112e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:50 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Volume volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 (12e0a62e-11f6-48c3-9af5-f112966d3ab0): created successfully Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8173215b-e4a0-4d42-9b4b-eb17bd5e112e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:50 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (1c11bf37-24e1-45d0-863c-bb056216db1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:50 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3a002b42-9494-4a0f-bb33-375407da0113 tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:06:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:51 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b47b51-ea9a-4333-8e4a-79063b6cfaab]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:51 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 Nov 05 04:06:51 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:51 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" returned: 0 in 0.394s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:51 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8 Nov 05 04:06:51 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:51 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" returned: 0 in 0.386s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8" released by "delete_volume" :: held 0.886s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Created reservations ['acc1d420-8f96-4444-bebb-07ccab231ca6', '83b7ea69-74d5-46ae-9765-04180346b9f1', 'bb9d11f6-ade9-414b-9b20-69aaf5022739', '90824232-5c0d-4016-8b07-fc901522b325'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Creating offline snapshot d74b664f-0509-4e65-a154-7d2c701c8be7 of volume 12e0a62e-11f6-48c3-9af5-f112966d3ab0 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ad94f4-1a5d-4e7e-a0af-2c412042c2cc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:52 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:52 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:52 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 Nov 05 04:06:52 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:52 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.340s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Deleted volume successfully. Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ed7251f-2e49-4982-b441-178830e5a91e tempest-ProjectReaderTests-1624626791 None] Lock "cinder-1f0799e0-8b07-4ff5-9eca-24d7c54eafb8-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:52 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0" returned: 0 in 0.460s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:52 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 1G Nov 05 04:06:52 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:53 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 1G" returned: 0 in 0.640s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:53 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 Nov 05 04:06:53 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:53 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7" returned: 0 in 0.502s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:53 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 is being set with open permissions: ugo+rw Nov 05 04:06:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:53 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 Nov 05 04:06:53 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:53 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:53 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (9749e6f0-b9f8-454d-8d12-fcaebf40c98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161d242a-a41d-47f7-bdfd-f53338922365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161d242a-a41d-47f7-bdfd-f53338922365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700097878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a412a98-3a7b-4c87-9339-95d1bcd9209d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:54Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedec8df-c45f-45a9-af5f-27d1af8e0f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedec8df-c45f-45a9-af5f-27d1af8e0f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef6904f-d1b4-4cf7-920f-6222cdbce716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef6904f-d1b4-4cf7-920f-6222cdbce716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a412a98-3a7b-4c87-9339-95d1bcd9209d', 'volume_name': 'volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ffcd60-16b4-4620-b253-943750deb182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ffcd60-16b4-4620-b253-943750deb182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416a8a00-2d46-44bb-8dc1-9a6865a7172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:54 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Volume 3a412a98-3a7b-4c87-9339-95d1bcd9209d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d', 'volume_size': 1} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:54 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:54 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.info Nov 05 04:06:54 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:54 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.info" returned: 0 in 0.325s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:54 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.info is being set with open permissions: ugo+rw Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:54 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.info Nov 05 04:06:54 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:54 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.info" returned: 0 in 0.327s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700097878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a412a98-3a7b-4c87-9339-95d1bcd9209d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:54Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Creating volume 3a412a98-3a7b-4c87-9339-95d1bcd9209d {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:54 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:55 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d 1073741824 Nov 05 04:06:55 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9bc719b2-970e-4052-a164-87cb5ce6e593 tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-d74b664f-0509-4e65-a154-7d2c701c8be7-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Lock "cinder-d74b664f-0509-4e65-a154-7d2c701c8be7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-12e0a62e-11f6-48c3-9af5-f112966d3ab0" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-12e0a62e-11f6-48c3-9af5-f112966d3ab0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-d74b664f-0509-4e65-a154-7d2c701c8be7" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-d74b664f-0509-4e65-a154-7d2c701c8be7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot d74b664f-0509-4e65-a154-7d2c701c8be7 of volume 12e0a62e-11f6-48c3-9af5-f112966d3ab0 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bca311d-e95e-4476-9129-0e09ff918c4d]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:55 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d 1073741824" returned: 0 in 0.671s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:55 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 Nov 05 04:06:55 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:55 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d Nov 05 04:06:55 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:56 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7" returned: 0 in 0.533s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:06:56 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a1e60f-9f29-4272-9b54-f6a690486c98]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d" returned: 0 in 0.399s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416a8a00-2d46-44bb-8dc1-9a6865a7172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39345e4a-dced-43e5-9ffa-0e6a74afde9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:56 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Volume volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d (3a412a98-3a7b-4c87-9339-95d1bcd9209d): created successfully Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39345e4a-dced-43e5-9ffa-0e6a74afde9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (9749e6f0-b9f8-454d-8d12-fcaebf40c98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Flow 'volume_create_manager' (ee38dd4e-3060-4b72-aca0-796a6109b13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26ebca4-f9f1-4bc2-bd43-41738eb45532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26ebca4-f9f1-4bc2-bd43-41738eb45532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-248009848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2125fffe-dffb-4686-890d-1d66d923fa18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7384d262b084451eb00b560c7e911aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:56Z,use_quota=True,user_id='1fd53d28207c47e7b451d5b58bb4ad7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:56 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 Nov 05 04:06:56 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f2103c-f55a-4911-b737-bf8329db011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f2103c-f55a-4911-b737-bf8329db011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63961f6-c261-4a7d-b3ce-67c3b1562988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63961f6-c261-4a7d-b3ce-67c3b1562988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2125fffe-dffb-4686-890d-1d66d923fa18', 'volume_name': 'volume-2125fffe-dffb-4686-890d-1d66d923fa18', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb57c4-4f48-4242-9607-7010302a7909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb57c4-4f48-4242-9607-7010302a7909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4103b497-f426-4123-ba38-2673d428a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:56 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Volume 2125fffe-dffb-4686-890d-1d66d923fa18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2125fffe-dffb-4686-890d-1d66d923fa18', 'volume_size': 1} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-248009848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2125fffe-dffb-4686-890d-1d66d923fa18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7384d262b084451eb00b560c7e911aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:56Z,use_quota=True,user_id='1fd53d28207c47e7b451d5b58bb4ad7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Creating volume 2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:06:56 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-96de491b-cc12-438e-ab0d-942288be7a67 tempest-ProjectReaderTests-1624626791 None] Created volume successfully. Nov 05 04:06:56 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 1073741824 Nov 05 04:06:56 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:56 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0" returned: 0 in 0.449s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:56 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 Nov 05 04:06:56 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:56 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 1073741824" returned: 0 in 0.498s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:56 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 Nov 05 04:06:56 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:56 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7" returned: 0 in 0.376s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:56 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7 Nov 05 04:06:56 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:57 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18" returned: 0 in 0.250s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4103b497-f426-4123-ba38-2673d428a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2125fffe-dffb-4686-890d-1d66d923fa18', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ec0d97-3136-439d-9e97-88df3e28a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:57 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Volume volume-2125fffe-dffb-4686-890d-1d66d923fa18 (2125fffe-dffb-4686-890d-1d66d923fa18): created successfully Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ec0d97-3136-439d-9e97-88df3e28a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Flow 'volume_create_manager' (ee38dd4e-3060-4b72-aca0-796a6109b13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-4f0ad93d-474d-4c86-9e96-c414fc438f39 tempest-SnapshotDependencyTests-1852983756 None] Created volume successfully. Nov 05 04:06:57 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0.d74b664f-0509-4e65-a154-7d2c701c8be7" returned: 0 in 0.287s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Creating offline snapshot 67a27ae8-4f15-4c62-905e-1362542204c2 of volume 3a412a98-3a7b-4c87-9339-95d1bcd9209d {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-d74b664f-0509-4e65-a154-7d2c701c8be7" released by "_delete_snapshot" :: held 1.804s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-12e0a62e-11f6-48c3-9af5-f112966d3ab0" released by "delete_snapshot" :: held 1.839s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4452c744-1d1f-4859-bfd7-7ef82f86cf62]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Created reservations ['5f54746f-fb58-4831-a61b-52120fbc7fc2', '24a650dc-ea13-4fdd-a6f7-7a5a32249922', '759c27fd-f95a-426d-bdb5-3ceebe2b6713', '4c81ac3d-6087-4e0d-b713-69f4da2b131a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:57 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d Nov 05 04:06:57 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:57 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c7be4517-22df-4951-9684-ca2f7b6719ef tempest-ProjectMemberTests-611526917 None] Lock "cinder-d74b664f-0509-4e65-a154-7d2c701c8be7-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-12e0a62e-11f6-48c3-9af5-f112966d3ab0-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-12e0a62e-11f6-48c3-9af5-f112966d3ab0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:57 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d" returned: 0 in 0.420s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-12e0a62e-11f6-48c3-9af5-f112966d3ab0" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:06:57 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 1G Nov 05 04:06:57 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-12e0a62e-11f6-48c3-9af5-f112966d3ab0" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f12b546-f314-4506-b84c-b3fea910435f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:57 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 Nov 05 04:06:57 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:58 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0" returned: 0 in 0.421s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:58 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 1G" returned: 0 in 0.542s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:58 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0 Nov 05 04:06:58 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:58 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 Nov 05 04:06:58 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:58 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-12e0a62e-11f6-48c3-9af5-f112966d3ab0" returned: 0 in 0.358s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:58 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-12e0a62e-11f6-48c3-9af5-f112966d3ab0" released by "delete_volume" :: held 0.863s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2" returned: 0 in 0.370s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:58 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 is being set with open permissions: ugo+rw Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:58 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 Nov 05 04:06:58 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Created reservations ['a5429189-89cb-42cb-acce-76ce6bd75aee', '65db6f57-cc03-4d27-a1b6-8203dcc4ed51', 'c2a79457-0e0d-4c38-bca1-1a45c7095643', 'f57c80e1-dbb4-49b8-af61-f4c062b4ba02'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:58 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:06:58 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:58 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2" returned: 0 in 0.406s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:59 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.info Nov 05 04:06:59 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:59 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.301s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:06:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b74e1575-00c2-4fe8-9f59-c2eb61f896c8 tempest-ProjectMemberTests-611526917 None] Lock "cinder-12e0a62e-11f6-48c3-9af5-f112966d3ab0-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:06:59 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.info" returned: 0 in 0.272s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:59 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.info is being set with open permissions: ugo+rw Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:59 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.info Nov 05 04:06:59 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (7f3f22d9-cc80-4a34-aa4f-e8b5199ff0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0120c6a-442d-4635-b6c5-01d04be4c623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0120c6a-442d-4635-b6c5-01d04be4c623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555735946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad35a140-e055-4ae4-a185-5af2e8b4e6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:59Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1f1a2a-3060-4143-8e83-7a2803193c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1f1a2a-3060-4143-8e83-7a2803193c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25dcec57-560e-4ae3-a948-ef47b9892e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25dcec57-560e-4ae3-a948-ef47b9892e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad35a140-e055-4ae4-a185-5af2e8b4e6ae', 'volume_name': 'volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a29126-9374-4fa8-97be-beb55287836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a29126-9374-4fa8-97be-beb55287836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b282ee-e1df-486b-8f22-db76d4b52f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:06:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Volume ad35a140-e055-4ae4-a185-5af2e8b4e6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae', 'volume_size': 1} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:06:59 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.info" returned: 0 in 0.247s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Creating offline snapshot 4c57df7e-8c5b-486e-b235-cd13c3bab2f3 of volume 2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:06:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ec13ef0f-b811-4c5d-b935-897bc33e0f2f tempest-ProjectReaderTests-1624626791 None] Create snapshot completed successfully Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e7276-5902-433a-b405-8df7c4ab285a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:06:59 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 Nov 05 04:06:59 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:06:59 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18" returned: 0 in 0.380s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:06:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:00 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 1G Nov 05 04:07:00 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-67a27ae8-4f15-4c62-905e-1362542204c2-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-67a27ae8-4f15-4c62-905e-1362542204c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-3a412a98-3a7b-4c87-9339-95d1bcd9209d" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-3a412a98-3a7b-4c87-9339-95d1bcd9209d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-67a27ae8-4f15-4c62-905e-1362542204c2" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:00 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-67a27ae8-4f15-4c62-905e-1362542204c2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Deleting offline snapshot 67a27ae8-4f15-4c62-905e-1362542204c2 of volume 3a412a98-3a7b-4c87-9339-95d1bcd9209d {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] snapshot_file for this snap is: volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 1G" returned: 0 in 0.513s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2125fffe-dffb-4686-890d-1d66d923fa18 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4616bb9-7fa7-4d9d-b132-04126f198ac2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:00 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2125fffe-dffb-4686-890d-1d66d923fa18 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 Nov 05 04:07:00 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:00 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 Nov 05 04:07:00 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:00 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2125fffe-dffb-4686-890d-1d66d923fa18 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3" returned: 0 in 0.339s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:00 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 is being set with open permissions: ugo+rw Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:00 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 Nov 05 04:07:00 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:00 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2" returned: 0 in 0.406s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcfe777-d806-4cab-9db8-371209aa08ba]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:01 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d Nov 05 04:07:01 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:01 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3" returned: 0 in 0.250s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:01 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.info Nov 05 04:07:01 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:01 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d" returned: 0 in 0.367s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:01 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 Nov 05 04:07:01 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:01 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.info" returned: 0 in 0.245s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:01 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.info is being set with open permissions: ugo+rw Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:01 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.info Nov 05 04:07:01 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:01 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.info" returned: 0 in 0.249s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555735946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad35a140-e055-4ae4-a185-5af2e8b4e6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:06:59Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Creating volume ad35a140-e055-4ae4-a185-5af2e8b4e6ae {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:01 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:01 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae 1073741824 Nov 05 04:07:01 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:01 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-87601d79-0a61-473e-bd7f-f34bf3a32071 tempest-SnapshotDependencyTests-1852983756 None] Create snapshot completed successfully Nov 05 04:07:01 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2" returned: 0 in 0.373s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:01 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2 Nov 05 04:07:01 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:02 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d.67a27ae8-4f15-4c62-905e-1362542204c2" returned: 0 in 0.304s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-67a27ae8-4f15-4c62-905e-1362542204c2" released by "_delete_snapshot" :: held 1.577s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-3a412a98-3a7b-4c87-9339-95d1bcd9209d" released by "delete_snapshot" :: held 1.605s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Created reservations ['56861292-c2e2-4ad8-bdb4-ef9c78e8418d', '37e08711-36e3-4cef-9b87-5a8d7d5a1e82', '9867774b-e8fd-4cd7-8b31-25452a8658e9', 'af28af2e-39a1-471c-af72-00204896b5ae'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:02 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae 1073741824" returned: 0 in 0.497s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Delete snapshot completed successfully. Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eac7fde4-2c69-4b31-a1cc-2a2b8f460285 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-67a27ae8-4f15-4c62-905e-1362542204c2-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:02 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae Nov 05 04:07:02 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:02 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" returned: 0 in 0.260s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b282ee-e1df-486b-8f22-db76d4b52f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21386057-475c-4e6b-abdc-219be96ea9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:02 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Volume volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae (ad35a140-e055-4ae4-a185-5af2e8b4e6ae): created successfully Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21386057-475c-4e6b-abdc-219be96ea9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (7f3f22d9-cc80-4a34-aa4f-e8b5199ff0d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d8f5e43e-024d-4343-bed9-b1b374845251 tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-3a412a98-3a7b-4c87-9339-95d1bcd9209d-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-3a412a98-3a7b-4c87-9339-95d1bcd9209d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-3a412a98-3a7b-4c87-9339-95d1bcd9209d" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-3a412a98-3a7b-4c87-9339-95d1bcd9209d" acquired by "delete_volume" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[34441f22-df4e-40d5-b780-65516ff17c55]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:02 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d Nov 05 04:07:02 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:03 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d" returned: 0 in 0.407s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:03 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d Nov 05 04:07:03 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Flow 'volume_create_manager' (64d9ed19-0dc6-4847-b449-1669ffb919bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7ce395-59ef-4a36-96aa-0a8b2093d368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7ce395-59ef-4a36-96aa-0a8b2093d368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a7cd9b-9886-469d-86a0-f0e41033ce00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7384d262b084451eb00b560c7e911aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c57df7e-8c5b-486e-b235-cd13c3bab2f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:03Z,use_quota=True,user_id='1fd53d28207c47e7b451d5b58bb4ad7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414106a2-0b3a-461a-86fa-e86bb0013530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414106a2-0b3a-461a-86fa-e86bb0013530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6989a74-5ea3-4e67-a2f5-a686689c6b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6989a74-5ea3-4e67-a2f5-a686689c6b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2a7cd9b-9886-469d-86a0-f0e41033ce00', 'volume_name': 'volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00', 'volume_size': 1, 'snapshot_id': '4c57df7e-8c5b-486e-b235-cd13c3bab2f3'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373aa499-2ffd-4fc6-948b-528d2f2918dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:03 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373aa499-2ffd-4fc6-948b-528d2f2918dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8ec147-07c2-45f1-a5fe-dcda77810076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:03 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Volume f2a7cd9b-9886-469d-86a0-f0e41033ce00: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00', 'volume_size': 1, 'snapshot_id': '4c57df7e-8c5b-486e-b235-cd13c3bab2f3'} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-3a412a98-3a7b-4c87-9339-95d1bcd9209d" returned: 0 in 0.292s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-3a412a98-3a7b-4c87-9339-95d1bcd9209d" released by "delete_volume" :: held 0.788s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-quobyte-4c57df7e-8c5b-486e-b235-cd13c3bab2f3-f2a7cd9b-9886-469d-86a0-f0e41033ce00" by "_create_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-4c57df7e-8c5b-486e-b235-cd13c3bab2f3-f2a7cd9b-9886-469d-86a0-f0e41033ce00" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Creating volume f2a7cd9b-9886-469d-86a0-f0e41033ce00 from snapshot 4c57df7e-8c5b-486e-b235-cd13c3bab2f3 {{(pid=87111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-quobyte-f2a7cd9b-9886-469d-86a0-f0e41033ce00" by "_copy_volume_from_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-f2a7cd9b-9886-469d-86a0-f0e41033ce00" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] snapshot: 4c57df7e-8c5b-486e-b235-cd13c3bab2f3, volume: f2a7cd9b-9886-469d-86a0-f0e41033ce00, {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Created reservations ['bc04259d-6594-46cf-a973-2a265d7511c0', '27fd0e4f-cf6b-4d46-ab58-8de244c3e4bf', '6ede9ea5-64d4-41e1-9009-600cf6710ccb', '37e065d9-e6b4-45fc-8659-242899aa94e9'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f2fc81-c462-4a0c-9507-a6c0b4a13a32]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:03 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:03 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:03 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 Nov 05 04:07:03 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:04 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.370s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:04 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Deleted volume successfully. Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-43a788b0-3232-4509-82a5-9bc773171693 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-3a412a98-3a7b-4c87-9339-95d1bcd9209d-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:04 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3" returned: 0 in 0.546s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2125fffe-dffb-4686-890d-1d66d923fa18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec5f9b3-b943-4a9f-80fb-ed639f2a5ba3]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:04 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 Nov 05 04:07:04 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (d9c8c3df-4bf9-417b-b4ea-95127e105504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae68b2f-9670-40f6-8749-f0e2666b4c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae68b2f-9670-40f6-8749-f0e2666b4c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206749991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ea7fd3-cd8d-4789-8e39-c0e22ad4c445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:04Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb8b76e-19ae-4bc2-99b9-7d58e2d5a35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb8b76e-19ae-4bc2-99b9-7d58e2d5a35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b89c41-43a0-4784-9c0a-b65180105000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b89c41-43a0-4784-9c0a-b65180105000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ea7fd3-cd8d-4789-8e39-c0e22ad4c445', 'volume_name': 'volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dc3acd-e4b2-4997-8243-d27101b7ccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dc3acd-e4b2-4997-8243-d27101b7ccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad2f9f1-dd84-44f8-8b99-9dd17c5c3f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:04 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Volume 89ea7fd3-cd8d-4789-8e39-c0e22ad4c445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445', 'volume_size': 1} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:04 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18" returned: 0 in 0.409s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] will copy from snapshot at /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Creating direct copy from snapshot {{(pid=87111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG cinder.utils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Path /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 not found in is_blk_device check {{(pid=87111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 04:07:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:04 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 Nov 05 04:07:04 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:11 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00" returned: 0 in 7.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:11 devstack cinder-volume[87111]: DEBUG cinder.image.image_utils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Image conversion details: src /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 {{(pid=87111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:07:11 devstack cinder-volume[87111]: INFO cinder.image.image_utils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Converted 1024.00 MB image at 140.27 MB/s Nov 05 04:07:11 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 is being set with open permissions: ugo+rw Nov 05 04:07:11 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:11 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 Nov 05 04:07:11 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:12 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00" returned: 0 in 0.252s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-f2a7cd9b-9886-469d-86a0-f0e41033ce00" released by "_copy_volume_from_snapshot" :: held 8.643s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-4c57df7e-8c5b-486e-b235-cd13c3bab2f3-f2a7cd9b-9886-469d-86a0-f0e41033ce00" released by "_create_volume_from_snapshot" :: held 8.720s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.744s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.431s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Creating offline snapshot c4ce17c9-4179-4d69-ab85-21ebc624351a of volume ad35a140-e055-4ae4-a185-5af2e8b4e6ae {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8ec147-07c2-45f1-a5fe-dcda77810076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00', 'volume_size': 1, 'snapshot_id': '4c57df7e-8c5b-486e-b235-cd13c3bab2f3'}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5cc9bf-1669-4c84-9788-018bb19d4af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2e3460-bc55-4dfd-b392-1bbb86b91c1a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:12 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Volume volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 (f2a7cd9b-9886-469d-86a0-f0e41033ce00): created successfully Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5cc9bf-1669-4c84-9788-018bb19d4af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Flow 'volume_create_manager' (64d9ed19-0dc6-4847-b449-1669ffb919bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:12 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-eec1054a-c12e-48c6-b2a9-da8d909396ab tempest-SnapshotDependencyTests-1852983756 None] Created volume successfully. Nov 05 04:07:12 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae Nov 05 04:07:12 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:12 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" returned: 0 in 0.384s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:12 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:12 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a 1G Nov 05 04:07:12 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:13 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a 1G" returned: 0 in 0.407s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:13 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a Nov 05 04:07:13 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-4c57df7e-8c5b-486e-b235-cd13c3bab2f3-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:13 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-4c57df7e-8c5b-486e-b235-cd13c3bab2f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-quobyte-2125fffe-dffb-4686-890d-1d66d923fa18" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a" returned: 0 in 0.344s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:13 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a is being set with open permissions: ugo+rw Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-2125fffe-dffb-4686-890d-1d66d923fa18" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-quobyte-4c57df7e-8c5b-486e-b235-cd13c3bab2f3" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:13 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a Nov 05 04:07:13 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-4c57df7e-8c5b-486e-b235-cd13c3bab2f3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Deleting offline snapshot 4c57df7e-8c5b-486e-b235-cd13c3bab2f3 of volume 2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] snapshot_file for this snap is: volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[db65b66d-1c0e-4538-b97d-fe1c15c73f87]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:13 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 Nov 05 04:07:13 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:13 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:13 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.info Nov 05 04:07:13 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:13 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3" returned: 0 in 0.427s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:13 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2125fffe-dffb-4686-890d-1d66d923fa18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfff7f8-c0fa-4dfc-93a5-496e92d3839b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:14 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.info" returned: 0 in 0.270s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:14 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.info is being set with open permissions: ugo+rw Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:14 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.info Nov 05 04:07:14 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:14 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 Nov 05 04:07:14 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:14 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.info" returned: 0 in 0.285s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.782s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206749991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ea7fd3-cd8d-4789-8e39-c0e22ad4c445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:04Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Creating volume 89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:14 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:14 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 1073741824 Nov 05 04:07:14 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:14 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-bfafc8e8-ba40-4959-a9c8-754113860dec tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:07:14 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18" returned: 0 in 0.611s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:14 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 Nov 05 04:07:14 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:14 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 1073741824" returned: 0 in 0.522s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:14 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:14 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 Nov 05 04:07:14 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:15 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3" returned: 0 in 0.388s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:15 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3 Nov 05 04:07:15 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:15 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" returned: 0 in 0.275s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad2f9f1-dd84-44f8-8b99-9dd17c5c3f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd766b30-0784-4d34-8110-b54231929850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:15 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Volume volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 (89ea7fd3-cd8d-4789-8e39-c0e22ad4c445): created successfully Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd766b30-0784-4d34-8110-b54231929850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (d9c8c3df-4bf9-417b-b4ea-95127e105504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3084b629-89fb-4080-9e74-955eccc7f7fb tempest-ProjectReaderTests-1624626791 None] Created volume successfully. Nov 05 04:07:15 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18.4c57df7e-8c5b-486e-b235-cd13c3bab2f3" returned: 0 in 0.287s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:15 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:15 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-4c57df7e-8c5b-486e-b235-cd13c3bab2f3" released by "_delete_snapshot" :: held 1.874s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-2125fffe-dffb-4686-890d-1d66d923fa18" released by "delete_snapshot" :: held 1.905s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-c4ce17c9-4179-4d69-ab85-21ebc624351a-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Created reservations ['3c01ef94-eda3-4159-a6e8-673d216cd154', '54ed478a-b3a6-47df-bfdf-9876626949a0', '958c4d67-0e95-48cd-b007-d3051568a681', '94f8107b-949c-4bed-ac23-a88bb201738e'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Lock "cinder-c4ce17c9-4179-4d69-ab85-21ebc624351a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-c4ce17c9-4179-4d69-ab85-21ebc624351a" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-c4ce17c9-4179-4d69-ab85-21ebc624351a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot c4ce17c9-4179-4d69-ab85-21ebc624351a of volume ad35a140-e055-4ae4-a185-5af2e8b4e6ae {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:15 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.339s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dada878e-6ceb-4b04-bc64-917045d71c40]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:07:15 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Delete snapshot completed successfully. Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-9dd7ea72-5f1d-46a7-839d-321b93bde4b1 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-4c57df7e-8c5b-486e-b235-cd13c3bab2f3-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:15 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a Nov 05 04:07:15 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Creating offline snapshot 9cad1a5e-9c2b-4109-936f-4ebe46683dbb of volume 89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8359ce69-830f-40aa-b0d9-66e2a170f948]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:16 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 Nov 05 04:07:16 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:16 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a" returned: 0 in 0.481s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad62cc-d434-43f6-875a-5dbe0f7f7795]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:16 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae Nov 05 04:07:16 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:16 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" returned: 0 in 0.411s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:16 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb 1G Nov 05 04:07:16 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:16 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" returned: 0 in 0.511s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-2125fffe-dffb-4686-890d-1d66d923fa18-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-2125fffe-dffb-4686-890d-1d66d923fa18-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:16 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a Nov 05 04:07:16 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-quobyte-2125fffe-dffb-4686-890d-1d66d923fa18" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-2125fffe-dffb-4686-890d-1d66d923fa18" acquired by "delete_volume" :: waited 0.034s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f3ca4-4143-416d-a333-a01664ca721f]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:16 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb 1G" returned: 0 in 0.622s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:16 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:16 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb Nov 05 04:07:16 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:17 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 Nov 05 04:07:17 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:17 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a" returned: 0 in 0.389s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:17 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a Nov 05 04:07:17 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:17 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb" returned: 0 in 0.294s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:17 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb is being set with open permissions: ugo+rw Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:17 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb Nov 05 04:07:17 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:17 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18" returned: 0 in 0.418s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:17 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae.c4ce17c9-4179-4d69-ab85-21ebc624351a" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:17 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18 Nov 05 04:07:17 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-c4ce17c9-4179-4d69-ab85-21ebc624351a" released by "_delete_snapshot" :: held 1.800s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" released by "delete_snapshot" :: held 1.843s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Created reservations ['f005df0f-e99b-4cb7-9888-31f11fff780d', 'c3fb43f3-fa41-407a-a82c-71926441b258', '33cdedbe-380f-4f2a-8ca6-7d6955d31240', '07c2ef1c-2656-413a-9608-c77b7dfa20ea'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:17 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5aec18b8-3a07-4985-b88b-4b9ed4bc19f2 tempest-ProjectMemberTests-611526917 None] Lock "cinder-c4ce17c9-4179-4d69-ab85-21ebc624351a-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:17 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb" returned: 0 in 0.280s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:17 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.info Nov 05 04:07:17 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:17 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2125fffe-dffb-4686-890d-1d66d923fa18" returned: 0 in 0.256s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-2125fffe-dffb-4686-890d-1d66d923fa18" released by "delete_volume" :: held 0.760s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-ad35a140-e055-4ae4-a185-5af2e8b4e6ae-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Created reservations ['5a5b026f-fb66-4cd9-b5ba-9cc37151b40b', '6fd88634-5d06-4e10-be16-dd8df6c1d1aa', '2180bb0f-31ef-45fe-9dae-5ced672e12d4', '679eaa95-d473-4896-af1c-fe7652ac14ff'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Lock "cinder-ad35a140-e055-4ae4-a185-5af2e8b4e6ae-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" acquired by "delete_volume" :: waited 0.051s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:17 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:17 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:17 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.info" returned: 0 in 0.325s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:17 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.info is being set with open permissions: ugo+rw Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-f2a7cd9b-9886-469d-86a0-f0e41033ce00-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c0e19b-1df6-4a97-9c18-0d33295a1672]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:17 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.info Nov 05 04:07:17 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:17 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-f2a7cd9b-9886-469d-86a0-f0e41033ce00-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "cinder-quobyte-f2a7cd9b-9886-469d-86a0-f0e41033ce00" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-f2a7cd9b-9886-469d-86a0-f0e41033ce00" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd056d-f710-4cd3-8cb1-bb8d33743b28]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:18 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae Nov 05 04:07:18 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:18 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.321s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Deleted volume successfully. Nov 05 04:07:18 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 Nov 05 04:07:18 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-02a38f46-5acc-477f-b750-bb1af20f9d6b tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-2125fffe-dffb-4686-890d-1d66d923fa18-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:18 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.info" returned: 0 in 0.343s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:18 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0b98fdf7-35e6-47f9-b6bd-68035ff0b5b1 tempest-ProjectReaderTests-1624626791 None] Create snapshot completed successfully Nov 05 04:07:18 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" returned: 0 in 0.435s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:18 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae Nov 05 04:07:18 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:18 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00" returned: 0 in 0.400s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:18 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00 Nov 05 04:07:18 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:18 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" returned: 0 in 0.265s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-ad35a140-e055-4ae4-a185-5af2e8b4e6ae" released by "delete_volume" :: held 0.797s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Created reservations ['e93b8f21-ff73-4939-94c6-7af2785fb798', '829387d6-c912-433d-93d6-56aa5aedfa8d', '48aa0167-4ebc-4c55-a6ea-ce55ba00752f', '178a95c5-a975-46e0-835f-e9ddcc273a83'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:18 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f2a7cd9b-9886-469d-86a0-f0e41033ce00" returned: 0 in 0.247s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-quobyte-f2a7cd9b-9886-469d-86a0-f0e41033ce00" released by "delete_volume" :: held 0.696s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Created reservations ['e42b0452-f987-401f-b5f0-074824f6e2be', '26b72b33-8f99-4fde-8f84-c5415283615f', '307fd742-770a-44c5-ab1b-dec37c8159bd', 'a26e0a66-7122-4a13-a9e8-481d935281af'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:18 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:18 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:18 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:18 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:18 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.290s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:19 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:19 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-98f1a84a-0aa2-45fb-a14a-521b67c8823b tempest-ProjectMemberTests-611526917 None] Lock "cinder-ad35a140-e055-4ae4-a185-5af2e8b4e6ae-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-9cad1a5e-9c2b-4109-936f-4ebe46683dbb-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Lock "cinder-9cad1a5e-9c2b-4109-936f-4ebe46683dbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-9cad1a5e-9c2b-4109-936f-4ebe46683dbb" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-9cad1a5e-9c2b-4109-936f-4ebe46683dbb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Deleting offline snapshot 9cad1a5e-9c2b-4109-936f-4ebe46683dbb of volume 89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:19 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] snapshot_file for this snap is: volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.360s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:19 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Deleted volume successfully. Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb1018-623b-46f7-bcf6-029a022bdb7a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-bb62ed34-1514-492c-9410-cc909796fc47 tempest-SnapshotDependencyTests-1852983756 None] Lock "cinder-f2a7cd9b-9886-469d-86a0-f0e41033ce00-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:19 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb Nov 05 04:07:19 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (496a7d0b-00f9-48eb-a1cb-cb5e8c49eea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9272d266-5d64-4110-a984-cbeb1c285093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9272d266-5d64-4110-a984-cbeb1c285093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-869913175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9a0be8-86dc-4720-b6e5-49ea52782002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:19Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7147a42d-5b99-4db3-8404-cf6cafecdcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7147a42d-5b99-4db3-8404-cf6cafecdcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8808f74-abf0-454e-aec1-ddcf273c0644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8808f74-abf0-454e-aec1-ddcf273c0644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9a0be8-86dc-4720-b6e5-49ea52782002', 'volume_name': 'volume-7c9a0be8-86dc-4720-b6e5-49ea52782002', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e1db81-8ee5-4afb-9851-7786b380be03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e1db81-8ee5-4afb-9851-7786b380be03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e1f585-dae8-41a5-9bfe-ad51e4106623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:19 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Volume 7c9a0be8-86dc-4720-b6e5-49ea52782002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9a0be8-86dc-4720-b6e5-49ea52782002', 'volume_size': 1} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-869913175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9a0be8-86dc-4720-b6e5-49ea52782002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:19Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Creating volume 7c9a0be8-86dc-4720-b6e5-49ea52782002 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:19 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:19 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 1073741824 Nov 05 04:07:19 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:19 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb" returned: 0 in 0.405s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a22a714-393e-43f9-a86e-4da34221f0c5]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:19 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:19 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 Nov 05 04:07:19 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:20 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 1073741824" returned: 0 in 0.497s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:20 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 Nov 05 04:07:20 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:20 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" returned: 0 in 0.421s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:20 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb Nov 05 04:07:20 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:20 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002" returned: 0 in 0.277s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e1f585-dae8-41a5-9bfe-ad51e4106623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9a0be8-86dc-4720-b6e5-49ea52782002', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1737e80c-ff0b-4983-8b6a-7f0578dbe21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Volume volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 (7c9a0be8-86dc-4720-b6e5-49ea52782002): created successfully Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1737e80c-ff0b-4983-8b6a-7f0578dbe21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (496a7d0b-00f9-48eb-a1cb-cb5e8c49eea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-318c3481-ae66-4e6c-917c-6207526bd88d tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:07:20 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb" returned: 0 in 0.378s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:20 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb Nov 05 04:07:20 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:20 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445.9cad1a5e-9c2b-4109-936f-4ebe46683dbb" returned: 0 in 0.253s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-9cad1a5e-9c2b-4109-936f-4ebe46683dbb" released by "_delete_snapshot" :: held 1.604s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" released by "delete_snapshot" :: held 1.634s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Created reservations ['23b19f1e-913d-47fb-b65a-1436e2120d70', '37b454a3-4052-480c-8166-60efba9aba47', '43c6ddcd-43cc-4340-8d4e-c4818d138672', '2e4f8755-f265-4843-b5aa-f3dc14c48383'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:20 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Delete snapshot completed successfully. Nov 05 04:07:20 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-2ef9a3a5-e0f3-44c1-a444-6757f48acdad tempest-ProjectReaderTests-1624626791 None] Lock "cinder-9cad1a5e-9c2b-4109-936f-4ebe46683dbb-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b3689f-0268-4935-a905-3955722e2234]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:21 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 Nov 05 04:07:21 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Creating offline snapshot ffdbd6e7-52e7-4990-8a06-9cf739a135da of volume 7c9a0be8-86dc-4720-b6e5-49ea52782002 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f539871-51c0-49db-97c8-e9da59eb3236]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:21 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" returned: 0 in 0.435s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:21 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 Nov 05 04:07:21 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:21 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445 Nov 05 04:07:21 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:22 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002" returned: 0 in 0.370s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:22 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" returned: 0 in 0.273s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:22 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da 1G Nov 05 04:07:22 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445" released by "delete_volume" :: held 0.795s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Created reservations ['8289b5f0-f655-4e11-9824-3e9bb6ae2ea4', '88f78a5d-1a8d-4942-8ae2-d2f564f93fc1', '77f5bcd8-31c8-4852-b2df-4de4fa318c4e', '883d8a38-60a3-4efc-ae5d-7704b95b1f17'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:22 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:22 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:22 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.271s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:22 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Deleted volume successfully. Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-64160187-bddc-489f-b072-8e6b31d6a5a4 tempest-ProjectReaderTests-1624626791 None] Lock "cinder-89ea7fd3-cd8d-4789-8e39-c0e22ad4c445-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:22 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da 1G" returned: 0 in 0.510s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:22 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da Nov 05 04:07:22 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:23 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da" returned: 0 in 0.381s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:23 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da is being set with open permissions: ugo+rw Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:23 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da Nov 05 04:07:23 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (dd67f104-a088-4caa-8664-164cd807db1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7c7b2d-b807-49ba-a904-0c6704ac0ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7c7b2d-b807-49ba-a904-0c6704ac0ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010125274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed43239-3555-43ff-93d4-ba07212c227b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:23Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c4650d-9a36-42ec-9619-6baa590946c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c4650d-9a36-42ec-9619-6baa590946c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4188a00e-9469-42b8-b552-5f000f8aea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4188a00e-9469-42b8-b552-5f000f8aea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed43239-3555-43ff-93d4-ba07212c227b', 'volume_name': 'volume-eed43239-3555-43ff-93d4-ba07212c227b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2722f707-821d-4608-ad0a-d627e6269072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2722f707-821d-4608-ad0a-d627e6269072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7217701d-9c25-466b-8f1d-b13dffff3a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:23 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Volume eed43239-3555-43ff-93d4-ba07212c227b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed43239-3555-43ff-93d4-ba07212c227b', 'volume_size': 1} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:23 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da" returned: 0 in 0.260s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:23 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.info Nov 05 04:07:23 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:23 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.info" returned: 0 in 0.268s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:23 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.info is being set with open permissions: ugo+rw Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:23 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.info Nov 05 04:07:23 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:23 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.info" returned: 0 in 0.277s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010125274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed43239-3555-43ff-93d4-ba07212c227b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9a055dc58b4a5583bc2573076df3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:23Z,use_quota=True,user_id='dafe58d795a242cb9ab60279b603d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Creating volume eed43239-3555-43ff-93d4-ba07212c227b {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:23 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:23 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b 1073741824 Nov 05 04:07:23 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-982a4372-551c-4204-b2e6-e49a0883566d tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:07:24 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b 1073741824" returned: 0 in 0.440s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:24 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b Nov 05 04:07:24 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:24 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b" returned: 0 in 0.251s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7217701d-9c25-466b-8f1d-b13dffff3a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed43239-3555-43ff-93d4-ba07212c227b', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d52a890-6b64-40f4-b791-6b57c5057cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Volume volume-eed43239-3555-43ff-93d4-ba07212c227b (eed43239-3555-43ff-93d4-ba07212c227b): created successfully Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d52a890-6b64-40f4-b791-6b57c5057cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Flow 'volume_create_manager' (dd67f104-a088-4caa-8664-164cd807db1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-142d76e9-2500-408a-a243-f69440ba33df tempest-ProjectReaderTests-1624626791 None] Created volume successfully. Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-ffdbd6e7-52e7-4990-8a06-9cf739a135da-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Lock "cinder-ffdbd6e7-52e7-4990-8a06-9cf739a135da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-7c9a0be8-86dc-4720-b6e5-49ea52782002" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-7c9a0be8-86dc-4720-b6e5-49ea52782002" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-ffdbd6e7-52e7-4990-8a06-9cf739a135da" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-ffdbd6e7-52e7-4990-8a06-9cf739a135da" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot ffdbd6e7-52e7-4990-8a06-9cf739a135da of volume 7c9a0be8-86dc-4720-b6e5-49ea52782002 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccf11f-53b6-41e3-a8e6-0f48149953b4]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:25 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da Nov 05 04:07:25 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Creating offline snapshot 582f8d1a-fd76-4e03-b367-80ec57504a70 of volume eed43239-3555-43ff-93d4-ba07212c227b {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7b6fba-8db8-4fbe-8cc2-e172871fd82e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:25 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da" returned: 0 in 0.406s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c9a0be8-86dc-4720-b6e5-49ea52782002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[107cc81b-1048-47f6-b3a8-7ac4dfdcda93]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:25 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b Nov 05 04:07:25 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:25 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 Nov 05 04:07:25 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:25 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b" returned: 0 in 0.405s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:25 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 1G Nov 05 04:07:25 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:25 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002" returned: 0 in 0.416s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:25 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da Nov 05 04:07:25 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:26 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da" returned: 0 in 0.409s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:26 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 1G" returned: 0 in 0.492s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed43239-3555-43ff-93d4-ba07212c227b -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:26 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da Nov 05 04:07:26 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:26 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed43239-3555-43ff-93d4-ba07212c227b -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 Nov 05 04:07:26 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:26 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002.ffdbd6e7-52e7-4990-8a06-9cf739a135da" returned: 0 in 0.273s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-ffdbd6e7-52e7-4990-8a06-9cf739a135da" released by "_delete_snapshot" :: held 1.622s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-7c9a0be8-86dc-4720-b6e5-49ea52782002" released by "delete_snapshot" :: held 1.647s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:26 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed43239-3555-43ff-93d4-ba07212c227b -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70" returned: 0 in 0.338s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:26 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 is being set with open permissions: ugo+rw Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:26 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 Nov 05 04:07:26 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Created reservations ['b6d34ba1-cca8-46bd-a13c-b9dc250dd2cd', 'b10d9f46-e3fc-4993-99e5-9f66159ed432', 'c6cee469-50ca-4453-afb9-494b87f7c2a2', '7c858f87-273e-4642-992d-4f48ccad2ac5'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:26 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-deda7eb9-f7f5-405c-ab91-a0000e5be76b tempest-ProjectMemberTests-611526917 None] Lock "cinder-ffdbd6e7-52e7-4990-8a06-9cf739a135da-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:26 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:26 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.info Nov 05 04:07:26 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-7c9a0be8-86dc-4720-b6e5-49ea52782002-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Lock "cinder-7c9a0be8-86dc-4720-b6e5-49ea52782002-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:27 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.info" returned: 0 in 0.299s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:27 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.info is being set with open permissions: ugo+rw Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-7c9a0be8-86dc-4720-b6e5-49ea52782002" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:27 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.info Nov 05 04:07:27 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-7c9a0be8-86dc-4720-b6e5-49ea52782002" acquired by "delete_volume" :: waited 0.031s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87476ad-3b42-4537-b252-a427f729d870]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:27 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 Nov 05 04:07:27 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:27 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.info" returned: 0 in 0.315s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a9043621-e21e-46d0-8f07-8e2dcdb35fc8 tempest-ProjectReaderTests-1624626791 None] Create snapshot completed successfully Nov 05 04:07:27 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002" returned: 0 in 0.425s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:27 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002 Nov 05 04:07:27 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:28 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-7c9a0be8-86dc-4720-b6e5-49ea52782002" returned: 0 in 0.257s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-7c9a0be8-86dc-4720-b6e5-49ea52782002" released by "delete_volume" :: held 0.792s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Created reservations ['4742dc39-c09c-464b-8c91-a070fd9a8b4c', '1d20b2b7-9083-434c-812e-e9ca15d1b633', '3664ad94-8fc0-4abe-8402-f51af442242a', '318e30e9-9369-4cfa-9028-f2f0473cefe4'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:28 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:28 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:28 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.298s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-582f8d1a-fd76-4e03-b367-80ec57504a70-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Lock "cinder-582f8d1a-fd76-4e03-b367-80ec57504a70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-eed43239-3555-43ff-93d4-ba07212c227b" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-fc3a509f-767f-4fe2-a2f8-6ed45eb2c44a tempest-ProjectMemberTests-611526917 None] Lock "cinder-7c9a0be8-86dc-4720-b6e5-49ea52782002-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-eed43239-3555-43ff-93d4-ba07212c227b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-582f8d1a-fd76-4e03-b367-80ec57504a70" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-582f8d1a-fd76-4e03-b367-80ec57504a70" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Deleting offline snapshot 582f8d1a-fd76-4e03-b367-80ec57504a70 of volume eed43239-3555-43ff-93d4-ba07212c227b {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] snapshot_file for this snap is: volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e16540-abb9-4013-a82f-b8c721046f73]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:28 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 Nov 05 04:07:28 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (e5760387-f8cd-444a-a984-54e10c579d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f5a209-76d8-46e2-a8f0-982a2d33ce65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f5a209-76d8-46e2-a8f0-982a2d33ce65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1981895968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a105fe-3ca3-4ffc-a664-b9703d3fd4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:29Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb4349e-76b1-48f6-89c6-b26aba8b1f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb4349e-76b1-48f6-89c6-b26aba8b1f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6745f91-5aea-4e53-891f-63e4a025c3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6745f91-5aea-4e53-891f-63e4a025c3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a105fe-3ca3-4ffc-a664-b9703d3fd4ff', 'volume_name': 'volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e82f31-dd37-4c00-85e1-2c89d21fc434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e82f31-dd37-4c00-85e1-2c89d21fc434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1081a9c-4d1a-47c4-af20-9131c0c0da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Volume 04a105fe-3ca3-4ffc-a664-b9703d3fd4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff', 'volume_size': 1} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1981895968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a105fe-3ca3-4ffc-a664-b9703d3fd4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:29Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Creating volume 04a105fe-3ca3-4ffc-a664-b9703d3fd4ff {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:29 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:29 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff 1073741824 Nov 05 04:07:29 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:29 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70" returned: 0 in 0.444s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed43239-3555-43ff-93d4-ba07212c227b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5757149-7887-4678-9f47-24c48d89533a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:29 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b Nov 05 04:07:29 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:29 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff 1073741824" returned: 0 in 0.536s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:29 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff Nov 05 04:07:29 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:29 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b" returned: 0 in 0.455s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:29 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 Nov 05 04:07:29 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:29 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" returned: 0 in 0.282s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1081a9c-4d1a-47c4-af20-9131c0c0da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f357f0-684b-473d-b768-850513880ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Volume volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff (04a105fe-3ca3-4ffc-a664-b9703d3fd4ff): created successfully Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f357f0-684b-473d-b768-850513880ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (e5760387-f8cd-444a-a984-54e10c579d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fe58482b-57f9-4ec0-b55f-719cdde4c97a tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:07:30 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70" returned: 0 in 0.406s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:30 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70 Nov 05 04:07:30 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:30 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b.582f8d1a-fd76-4e03-b367-80ec57504a70" returned: 0 in 0.289s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-582f8d1a-fd76-4e03-b367-80ec57504a70" released by "_delete_snapshot" :: held 1.720s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-eed43239-3555-43ff-93d4-ba07212c227b" released by "delete_snapshot" :: held 1.752s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Created reservations ['17833b0f-e7bd-4cc4-a6b0-a79d4f8afe99', '09b29100-559b-4135-83b2-7049f858a8eb', '76129db1-6f5b-4f4a-aaee-eb70fe8812ec', 'f7770f5f-fcfa-48dc-b9a5-7e6c48cdfb38'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:30 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Delete snapshot completed successfully. Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-84a6649d-f9cc-49e5-bde0-710c6d80b03b tempest-ProjectReaderTests-1624626791 None] Lock "cinder-582f8d1a-fd76-4e03-b367-80ec57504a70-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-eed43239-3555-43ff-93d4-ba07212c227b-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Lock "cinder-eed43239-3555-43ff-93d4-ba07212c227b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Acquiring lock "cinder-quobyte-eed43239-3555-43ff-93d4-ba07212c227b" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-eed43239-3555-43ff-93d4-ba07212c227b" acquired by "delete_volume" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[529fa637-417e-4596-9536-1c1d72486651]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:31 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b Nov 05 04:07:31 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Creating offline snapshot c661d822-f1d7-4b63-8576-cb7c43c31acd of volume 04a105fe-3ca3-4ffc-a664-b9703d3fd4ff {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a373e0-0b0d-4777-82b5-f451e6f3cf7a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:31 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff Nov 05 04:07:31 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:31 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b" returned: 0 in 0.410s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:31 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b Nov 05 04:07:31 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:31 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" returned: 0 in 0.371s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:31 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:31 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd 1G Nov 05 04:07:31 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-eed43239-3555-43ff-93d4-ba07212c227b" returned: 0 in 0.267s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Lock "cinder-quobyte-eed43239-3555-43ff-93d4-ba07212c227b" released by "delete_volume" :: held 0.764s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Created reservations ['ddc855df-7ac5-4a48-8569-01ff8b318abb', '1132fd1d-0611-4537-aacf-96df0abe0326', '7e48e52f-4e53-4860-823a-db5939a469cb', 'f19e44b4-7763-4930-9d26-9c52d922f6cb'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:31 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:31 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:32 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd 1G" returned: 0 in 0.473s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:32 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.314s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:32 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Deleted volume successfully. Nov 05 04:07:32 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd Nov 05 04:07:32 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-d298c260-9149-4f5f-a45f-f686e545adbf tempest-ProjectReaderTests-1624626791 None] Lock "cinder-eed43239-3555-43ff-93d4-ba07212c227b-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:32 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd" returned: 0 in 0.318s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:32 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd is being set with open permissions: ugo+rw Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:32 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd Nov 05 04:07:32 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:32 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd" returned: 0 in 0.261s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:32 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.info Nov 05 04:07:32 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:32 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.info" returned: 0 in 0.258s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:32 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.info is being set with open permissions: ugo+rw Nov 05 04:07:32 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:32 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.info Nov 05 04:07:32 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:33 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.info" returned: 0 in 0.258s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:33 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:33 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:INSERT=53,cinder:UPDATE=228,cinder:SELECT=191,cinder:DELETE=12 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:07:33 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=170,cinder:INSERT=64,cinder:UPDATE=196,cinder:DELETE=21 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:07:33 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-aa976969-21a3-4404-b2ed-ae83aeee0735 tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-c661d822-f1d7-4b63-8576-cb7c43c31acd-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Lock "cinder-c661d822-f1d7-4b63-8576-cb7c43c31acd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-c661d822-f1d7-4b63-8576-cb7c43c31acd" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-c661d822-f1d7-4b63-8576-cb7c43c31acd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot c661d822-f1d7-4b63-8576-cb7c43c31acd of volume 04a105fe-3ca3-4ffc-a664-b9703d3fd4ff {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e91df19-7d26-41ee-a0af-4ec2e152fd98]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:34 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd Nov 05 04:07:34 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:34 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd" returned: 0 in 0.357s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9a66ca-0ccb-4289-98e0-ecb026f9e9f1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:34 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:34 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff Nov 05 04:07:34 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:35 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" returned: 0 in 0.347s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:35 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd Nov 05 04:07:35 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:35 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd" returned: 0 in 0.323s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:35 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd Nov 05 04:07:35 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:35 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff.c661d822-f1d7-4b63-8576-cb7c43c31acd" returned: 0 in 0.248s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-c661d822-f1d7-4b63-8576-cb7c43c31acd" released by "_delete_snapshot" :: held 1.373s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" released by "delete_snapshot" :: held 1.397s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Created reservations ['f19ee862-1e22-450c-8308-e2a9f427ca6e', 'f4b2a32b-7964-415d-b7ed-757d2c60fa2b', '0849f7cf-d02c-4f32-a7f1-f12367f814e7', '11e42e97-a52b-40bf-8eda-9774d9620e1a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:35 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:07:35 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-957c9436-f040-4f49-a26d-d9e71badba0b tempest-ProjectMemberTests-611526917 None] Lock "cinder-c661d822-f1d7-4b63-8576-cb7c43c31acd-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Lock "cinder-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:36 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:36 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb473e7d-b1a1-4c13-bd49-303f69fd6602]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:36 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff Nov 05 04:07:36 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:36 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" returned: 0 in 0.360s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:36 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:36 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff Nov 05 04:07:36 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:37 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" returned: 0 in 0.242s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff" released by "delete_volume" :: held 0.663s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Created reservations ['61851467-2a8c-4763-a8e5-88f17523ad51', '68a318c4-0d59-4419-93e9-55f845a937c8', 'c34524d1-1212-4fbd-9e2d-d42f57dea01e', 'b7065b29-ef84-40a2-b57a-2a00bb04a73a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:37 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:37 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:37 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.238s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:37 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:07:37 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-c2c7a636-9ff0-4c68-8f2d-8a5445b1512a tempest-ProjectMemberTests-611526917 None] Lock "cinder-04a105fe-3ca3-4ffc-a664-b9703d3fd4ff-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (a5c57a8d-c825-4d01-b6fd-18aad296463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd64776-ac6f-4557-977d-2393d421c44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd64776-ac6f-4557-977d-2393d421c44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187949546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57cc19b-b9ba-4ea6-b899-f93346feced1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:38Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65bd23c-94e0-4d5f-aa49-7778d422caa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65bd23c-94e0-4d5f-aa49-7778d422caa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10042d52-9ef0-43e8-91b0-b738f0f3f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10042d52-9ef0-43e8-91b0-b738f0f3f753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57cc19b-b9ba-4ea6-b899-f93346feced1', 'volume_name': 'volume-f57cc19b-b9ba-4ea6-b899-f93346feced1', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e3d798-748a-49a3-a19e-124ce07f0b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e3d798-748a-49a3-a19e-124ce07f0b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c881832c-502f-4d9e-9553-0a949475b5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:38 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Volume f57cc19b-b9ba-4ea6-b899-f93346feced1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57cc19b-b9ba-4ea6-b899-f93346feced1', 'volume_size': 1} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187949546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57cc19b-b9ba-4ea6-b899-f93346feced1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:38Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Creating volume f57cc19b-b9ba-4ea6-b899-f93346feced1 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:38 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:38 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 1073741824 Nov 05 04:07:38 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:38 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 1073741824" returned: 0 in 0.408s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:38 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 Nov 05 04:07:38 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:38 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1" returned: 0 in 0.248s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c881832c-502f-4d9e-9553-0a949475b5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57cc19b-b9ba-4ea6-b899-f93346feced1', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1399271-4190-43b8-a94c-ea82b4d7101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:38 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Volume volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 (f57cc19b-b9ba-4ea6-b899-f93346feced1): created successfully Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1399271-4190-43b8-a94c-ea82b4d7101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (a5c57a8d-c825-4d01-b6fd-18aad296463a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:38 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-349f89b7-d921-47fb-9f8a-d4bb782dd4b7 tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Creating offline snapshot 7cb3f62c-6d45-48d7-9998-e1efa4462907 of volume f57cc19b-b9ba-4ea6-b899-f93346feced1 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c528a6-c594-4694-b58c-0e71bbcadc2e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:39 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 Nov 05 04:07:39 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:39 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1" returned: 0 in 0.369s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:39 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 1G Nov 05 04:07:39 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:39 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 1G" returned: 0 in 0.382s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:39 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:39 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 Nov 05 04:07:39 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:40 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907" returned: 0 in 0.278s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:40 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 is being set with open permissions: ugo+rw Nov 05 04:07:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:40 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 Nov 05 04:07:40 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:40 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907" returned: 0 in 0.230s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:40 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.info Nov 05 04:07:40 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:40 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.info" returned: 0 in 0.243s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:40 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.info is being set with open permissions: ugo+rw Nov 05 04:07:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:40 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.info Nov 05 04:07:40 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:40 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:40 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.info" returned: 0 in 0.234s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:41 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d5645b4d-978d-4c01-a987-f1f002e8cd1c tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-7cb3f62c-6d45-48d7-9998-e1efa4462907-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Lock "cinder-7cb3f62c-6d45-48d7-9998-e1efa4462907-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-f57cc19b-b9ba-4ea6-b899-f93346feced1" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-f57cc19b-b9ba-4ea6-b899-f93346feced1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-7cb3f62c-6d45-48d7-9998-e1efa4462907" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-7cb3f62c-6d45-48d7-9998-e1efa4462907" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot 7cb3f62c-6d45-48d7-9998-e1efa4462907 of volume f57cc19b-b9ba-4ea6-b899-f93346feced1 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2c0131-f6e9-4160-bd1d-70e2b141bf82]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:41 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 Nov 05 04:07:41 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:41 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907" returned: 0 in 0.343s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f57cc19b-b9ba-4ea6-b899-f93346feced1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcea2e3-a76e-4cc1-88fc-7bff43904943]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:41 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:41 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 Nov 05 04:07:41 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:42 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1" returned: 0 in 0.340s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:42 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 Nov 05 04:07:42 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:42 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907" returned: 0 in 0.328s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:42 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907 Nov 05 04:07:42 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:42 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1.7cb3f62c-6d45-48d7-9998-e1efa4462907" returned: 0 in 0.240s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-7cb3f62c-6d45-48d7-9998-e1efa4462907" released by "_delete_snapshot" :: held 1.349s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-f57cc19b-b9ba-4ea6-b899-f93346feced1" released by "delete_snapshot" :: held 1.377s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Created reservations ['dd85545d-37e0-407f-afe2-8b8cf4971823', 'b3bb2cf8-9022-44b7-bedb-d92e1b09f182', 'ff8ec9fe-4699-4f59-bcf3-e06fbde18188', '0116cf51-38b6-4b36-9528-d4eebfd0d71a'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:42 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:07:42 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-b4e68b72-832e-43fe-b679-ca9bbd54a2ad tempest-ProjectMemberTests-611526917 None] Lock "cinder-7cb3f62c-6d45-48d7-9998-e1efa4462907-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-f57cc19b-b9ba-4ea6-b899-f93346feced1-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Lock "cinder-f57cc19b-b9ba-4ea6-b899-f93346feced1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-f57cc19b-b9ba-4ea6-b899-f93346feced1" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:43 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-f57cc19b-b9ba-4ea6-b899-f93346feced1" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:43 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3527bb87-53cf-4f1a-8724-2de257f8cc5a]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:43 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 Nov 05 04:07:43 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:43 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1" returned: 0 in 0.350s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:43 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:43 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1 Nov 05 04:07:43 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:44 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f57cc19b-b9ba-4ea6-b899-f93346feced1" returned: 0 in 0.241s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-f57cc19b-b9ba-4ea6-b899-f93346feced1" released by "delete_volume" :: held 0.650s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Created reservations ['7b654b9c-a726-44ea-b57a-7b8d3efa86f7', '8e91636b-c092-49d9-896b-6ce45892e219', '1656ba49-7d7a-4bc5-a39d-1bce040ab69d', '1a8daf74-48ca-4767-b5a5-207e8719b7df'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:44 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:44 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:44 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.243s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:44 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:07:44 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-ce2d3916-bd13-4976-80b0-53a7a870f9de tempest-ProjectMemberTests-611526917 None] Lock "cinder-f57cc19b-b9ba-4ea6-b899-f93346feced1-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (69bfb952-d1df-4f9d-a16b-74291e6aae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87600a46-424e-4bf3-bf58-34fae9ddb11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87600a46-424e-4bf3-bf58-34fae9ddb11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2096368042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54abb0b-16e1-443e-883b-83306fae6e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:45Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b791b2f5-4ac4-4766-bac9-5e7f8c456217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b791b2f5-4ac4-4766-bac9-5e7f8c456217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4828617-f088-4ba3-8e0b-593b8502c7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4828617-f088-4ba3-8e0b-593b8502c7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54abb0b-16e1-443e-883b-83306fae6e4f', 'volume_name': 'volume-b54abb0b-16e1-443e-883b-83306fae6e4f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c99edf-36ba-468d-bea2-7d7be7c05d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c99edf-36ba-468d-bea2-7d7be7c05d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3b5249-609e-4de8-9739-e29d2b37f079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:45 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Volume b54abb0b-16e1-443e-883b-83306fae6e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54abb0b-16e1-443e-883b-83306fae6e4f', 'volume_size': 1} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2096368042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54abb0b-16e1-443e-883b-83306fae6e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:45Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Creating volume b54abb0b-16e1-443e-883b-83306fae6e4f {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:45 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:45 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f 1073741824 Nov 05 04:07:45 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:45 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f 1073741824" returned: 0 in 0.404s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:45 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f Nov 05 04:07:45 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:45 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f" returned: 0 in 0.242s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3b5249-609e-4de8-9739-e29d2b37f079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54abb0b-16e1-443e-883b-83306fae6e4f', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b37eedf-8920-4d92-b8b7-99479b305078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:45 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Volume volume-b54abb0b-16e1-443e-883b-83306fae6e4f (b54abb0b-16e1-443e-883b-83306fae6e4f): created successfully Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b37eedf-8920-4d92-b8b7-99479b305078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:45 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (69bfb952-d1df-4f9d-a16b-74291e6aae1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:45 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d5e8722f-93fc-48c5-ac7e-40d4fb63de95 tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Creating offline snapshot 0d49760b-14a0-4f99-aeb7-cda3f842a4da of volume b54abb0b-16e1-443e-883b-83306fae6e4f {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e07ede-ff3e-45f5-9150-239aedf0a1db]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:46 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f Nov 05 04:07:46 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:46 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f" returned: 0 in 0.347s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:46 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da 1G Nov 05 04:07:46 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:46 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da 1G" returned: 0 in 0.386s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:46 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54abb0b-16e1-443e-883b-83306fae6e4f -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:46 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54abb0b-16e1-443e-883b-83306fae6e4f -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da Nov 05 04:07:46 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:47 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54abb0b-16e1-443e-883b-83306fae6e4f -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da" returned: 0 in 0.285s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:47 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da is being set with open permissions: ugo+rw Nov 05 04:07:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:47 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da Nov 05 04:07:47 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:47 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da" returned: 0 in 0.236s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:47 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.info Nov 05 04:07:47 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:47 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.info" returned: 0 in 0.250s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:47 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.info is being set with open permissions: ugo+rw Nov 05 04:07:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:47 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.info Nov 05 04:07:47 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:47 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.info" returned: 0 in 0.234s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:47 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:48 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-16b66adc-84e2-421c-8267-63f38a2eddf7 tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-0d49760b-14a0-4f99-aeb7-cda3f842a4da-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Lock "cinder-0d49760b-14a0-4f99-aeb7-cda3f842a4da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-b54abb0b-16e1-443e-883b-83306fae6e4f" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-b54abb0b-16e1-443e-883b-83306fae6e4f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-0d49760b-14a0-4f99-aeb7-cda3f842a4da" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-0d49760b-14a0-4f99-aeb7-cda3f842a4da" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot 0d49760b-14a0-4f99-aeb7-cda3f842a4da of volume b54abb0b-16e1-443e-883b-83306fae6e4f {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f5fe27-ce79-42e3-be91-b59c22f20cf6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:48 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da Nov 05 04:07:48 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:48 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da" returned: 0 in 0.352s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54abb0b-16e1-443e-883b-83306fae6e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7bad34-9b20-4765-a19a-0a75f33f76c2]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:48 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:48 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f Nov 05 04:07:48 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:49 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f" returned: 0 in 0.346s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:49 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da Nov 05 04:07:49 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:49 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da" returned: 0 in 0.313s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:49 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da Nov 05 04:07:49 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:49 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f.0d49760b-14a0-4f99-aeb7-cda3f842a4da" returned: 0 in 0.246s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-0d49760b-14a0-4f99-aeb7-cda3f842a4da" released by "_delete_snapshot" :: held 1.350s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-b54abb0b-16e1-443e-883b-83306fae6e4f" released by "delete_snapshot" :: held 1.374s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Created reservations ['826e58ab-81f2-4b68-9941-6abbe26ae830', 'df800f32-7258-4b94-a0a9-62faad924093', 'ef425aed-0337-4dfb-97d8-a90a626f2b76', '5954fb3b-e9ff-4179-8e97-c2a4b1612b3b'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:49 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:07:49 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-1ea77d07-e67d-4b94-bf8c-bd27281da514 tempest-ProjectMemberTests-611526917 None] Lock "cinder-0d49760b-14a0-4f99-aeb7-cda3f842a4da-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-b54abb0b-16e1-443e-883b-83306fae6e4f-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Lock "cinder-b54abb0b-16e1-443e-883b-83306fae6e4f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-b54abb0b-16e1-443e-883b-83306fae6e4f" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:50 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-b54abb0b-16e1-443e-883b-83306fae6e4f" acquired by "delete_volume" :: waited 0.013s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:50 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[352ea281-7167-420b-b563-b7c96c141d55]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:50 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f Nov 05 04:07:50 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:50 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f" returned: 0 in 0.358s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:50 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:50 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f Nov 05 04:07:50 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:51 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-b54abb0b-16e1-443e-883b-83306fae6e4f" returned: 0 in 0.241s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-b54abb0b-16e1-443e-883b-83306fae6e4f" released by "delete_volume" :: held 0.660s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Created reservations ['8dfdbe5d-3d3b-4cd1-a650-d2770aea6e84', '17e9d50d-1209-44d5-af69-4d15dbf492a5', 'c0593743-3f35-4f18-9bf3-6a4030e8ac40', '6a2366dc-3591-4c9e-b050-683b05364b92'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:51 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:51 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:51 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.249s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:51 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:07:51 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-3d43b7e7-6b93-4f07-a521-f84ad05bcdbd tempest-ProjectMemberTests-611526917 None] Lock "cinder-b54abb0b-16e1-443e-883b-83306fae6e4f-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (f904a096-5b9d-4b98-863f-ba086fc678aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53b0f86-8560-4a13-95ab-ac3c742c1c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53b0f86-8560-4a13-95ab-ac3c742c1c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368009687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271e6001-6a55-4753-b14e-9c9d17964e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:52Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f985e254-2c49-4d87-9d27-662986ec0930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f985e254-2c49-4d87-9d27-662986ec0930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ccdc3a-551c-43c0-9045-52b951f2496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ccdc3a-551c-43c0-9045-52b951f2496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271e6001-6a55-4753-b14e-9c9d17964e9a', 'volume_name': 'volume-271e6001-6a55-4753-b14e-9c9d17964e9a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81aa75d8-680d-4981-bf37-46c1d4940fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81aa75d8-680d-4981-bf37-46c1d4940fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d137a61f-c1d7-4ca3-b13a-22300d8ddd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Volume 271e6001-6a55-4753-b14e-9c9d17964e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271e6001-6a55-4753-b14e-9c9d17964e9a', 'volume_size': 1} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368009687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271e6001-6a55-4753-b14e-9c9d17964e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:52Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Creating volume 271e6001-6a55-4753-b14e-9c9d17964e9a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:52 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:52 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a 1073741824 Nov 05 04:07:52 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:52 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a 1073741824" returned: 0 in 0.399s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:52 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a Nov 05 04:07:52 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:52 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a" returned: 0 in 0.235s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d137a61f-c1d7-4ca3-b13a-22300d8ddd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271e6001-6a55-4753-b14e-9c9d17964e9a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91fde3cb-179b-433a-afce-6bf50169e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:52 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Volume volume-271e6001-6a55-4753-b14e-9c9d17964e9a (271e6001-6a55-4753-b14e-9c9d17964e9a): created successfully Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91fde3cb-179b-433a-afce-6bf50169e729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:52 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (f904a096-5b9d-4b98-863f-ba086fc678aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:52 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-7b1c06b0-5be5-48a6-bda2-98dd48b96780 tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Creating offline snapshot c38400cf-171d-4005-9b2e-a34413f3278b of volume 271e6001-6a55-4753-b14e-9c9d17964e9a {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ff72c9-5ae4-4a58-b793-ea9b7a4622c0]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:53 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a Nov 05 04:07:53 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:53 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a" returned: 0 in 0.340s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:53 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b 1G Nov 05 04:07:53 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:53 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b 1G" returned: 0 in 0.369s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:53 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-271e6001-6a55-4753-b14e-9c9d17964e9a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:53 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-271e6001-6a55-4753-b14e-9c9d17964e9a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b Nov 05 04:07:53 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:54 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-271e6001-6a55-4753-b14e-9c9d17964e9a -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b" returned: 0 in 0.281s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:54 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b is being set with open permissions: ugo+rw Nov 05 04:07:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:54 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b Nov 05 04:07:54 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:54 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b" returned: 0 in 0.234s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:54 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.info Nov 05 04:07:54 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:54 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.info" returned: 0 in 0.253s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:54 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.info is being set with open permissions: ugo+rw Nov 05 04:07:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:54 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.info Nov 05 04:07:54 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:54 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.info" returned: 0 in 0.233s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:54 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:55 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-65199fa1-91c7-4a78-b8c4-9567283cc866 tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-c38400cf-171d-4005-9b2e-a34413f3278b-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Lock "cinder-c38400cf-171d-4005-9b2e-a34413f3278b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-271e6001-6a55-4753-b14e-9c9d17964e9a" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-271e6001-6a55-4753-b14e-9c9d17964e9a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-c38400cf-171d-4005-9b2e-a34413f3278b" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-c38400cf-171d-4005-9b2e-a34413f3278b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot c38400cf-171d-4005-9b2e-a34413f3278b of volume 271e6001-6a55-4753-b14e-9c9d17964e9a {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a199b5f3-c8db-457e-9c9a-c0e6670491ec]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:55 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b Nov 05 04:07:55 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:55 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b" returned: 0 in 0.345s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-271e6001-6a55-4753-b14e-9c9d17964e9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fca541-58a9-4629-954e-7fff6aeb85cc]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:55 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:55 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a Nov 05 04:07:55 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:56 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a" returned: 0 in 0.347s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:56 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b Nov 05 04:07:56 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:56 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b" returned: 0 in 0.322s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:56 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b Nov 05 04:07:56 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:56 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a.c38400cf-171d-4005-9b2e-a34413f3278b" returned: 0 in 0.248s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-c38400cf-171d-4005-9b2e-a34413f3278b" released by "_delete_snapshot" :: held 1.357s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-271e6001-6a55-4753-b14e-9c9d17964e9a" released by "delete_snapshot" :: held 1.376s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Created reservations ['e35d94b5-d9ed-4db6-9386-8ba1d6193a7b', 'dadd6392-4bf2-4681-aba2-18f3a2035d96', 'bd37b22c-9a28-4bcf-98d7-243263d0626f', 'cd0e3c5f-b181-4496-a30e-8ccd164dcf80'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:56 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:07:56 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-a82f2585-04e5-4bf7-8542-8c23a6322c3e tempest-ProjectMemberTests-611526917 None] Lock "cinder-c38400cf-171d-4005-9b2e-a34413f3278b-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-271e6001-6a55-4753-b14e-9c9d17964e9a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Lock "cinder-271e6001-6a55-4753-b14e-9c9d17964e9a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-271e6001-6a55-4753-b14e-9c9d17964e9a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:07:57 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-271e6001-6a55-4753-b14e-9c9d17964e9a" acquired by "delete_volume" :: waited 0.016s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:07:57 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[265925f5-20a5-4270-9b43-ac52050a5123]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:07:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:57 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a Nov 05 04:07:57 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:57 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:57 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:57 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a Nov 05 04:07:57 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:58 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-271e6001-6a55-4753-b14e-9c9d17964e9a" returned: 0 in 0.235s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-271e6001-6a55-4753-b14e-9c9d17964e9a" released by "delete_volume" :: held 0.634s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Created reservations ['b2a70b7c-c0e3-49de-8782-681cf415c293', 'cee22dd6-f723-46c4-8f6b-2375576d364c', '62493c6c-41ac-4be4-ae38-c77930bd2cbf', 'f210e1a8-777c-4893-8896-ec50022c3226'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:58 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:07:58 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:58 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.230s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:07:58 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:07:58 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-6f475f37-757e-4301-8c22-a74e87702d9a tempest-ProjectMemberTests-611526917 None] Lock "cinder-271e6001-6a55-4753-b14e-9c9d17964e9a-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (44fa9013-39a0-4cb3-9762-a2a497cbc19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af986da-85f0-4fba-afb9-c9496a6c5f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af986da-85f0-4fba-afb9-c9496a6c5f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031763790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d4bea5-a66b-49bf-9f5c-cc16acb37d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:59Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff96e5dc-ea98-4a3d-bb3d-318a69977806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff96e5dc-ea98-4a3d-bb3d-318a69977806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d8c84e-c972-4580-9457-6e562008539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d8c84e-c972-4580-9457-6e562008539c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d4bea5-a66b-49bf-9f5c-cc16acb37d61', 'volume_name': 'volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e73794-adaf-458d-968a-44fcf5d002ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e73794-adaf-458d-968a-44fcf5d002ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d1e8b1-f997-4518-960b-6919aae71cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Volume 94d4bea5-a66b-49bf-9f5c-cc16acb37d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61', 'volume_size': 1} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031763790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d4bea5-a66b-49bf-9f5c-cc16acb37d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c57e773d2b4847ac1fb60cf6096caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:07:59Z,use_quota=True,user_id='e387e98da3424ed498b24c02fe7eef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Creating volume 94d4bea5-a66b-49bf-9f5c-cc16acb37d61 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:07:59 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:59 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 1073741824 Nov 05 04:07:59 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:59 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 1073741824" returned: 0 in 0.398s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:07:59 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 Nov 05 04:07:59 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:07:59 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" returned: 0 in 0.249s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d1e8b1-f997-4518-960b-6919aae71cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8547b4ee-20a4-40ec-b9a6-a3cfb82b0bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:07:59 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Volume volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 (94d4bea5-a66b-49bf-9f5c-cc16acb37d61): created successfully Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8547b4ee-20a4-40ec-b9a6-a3cfb82b0bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:07:59 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Flow 'volume_create_manager' (44fa9013-39a0-4cb3-9762-a2a497cbc19b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:07:59 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-6b1f8d17-b91f-4ae8-95d8-9ffdaee0e2e3 tempest-ProjectMemberTests-611526917 None] Created volume successfully. Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Creating offline snapshot debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 of volume 94d4bea5-a66b-49bf-9f5c-cc16acb37d61 {{(pid=87111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e68a6d-3eb1-4e5a-8a40-54494e525dc1]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:00 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 Nov 05 04:08:00 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:00 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" returned: 0 in 0.341s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 1G {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:00 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 1G Nov 05 04:08:00 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:00 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 1G" returned: 0 in 0.385s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:00 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:00 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 Nov 05 04:08:00 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:01 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 -F qcow2 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65" returned: 0 in 0.281s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:01 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 is being set with open permissions: ugo+rw Nov 05 04:08:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:01 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 Nov 05 04:08:01 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:01 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65" returned: 0 in 0.231s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:01 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.info Nov 05 04:08:01 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:01 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.info" returned: 0 in 0.260s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:01 devstack cinder-volume[87111]: WARNING cinder.volume.drivers.remotefs [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.info is being set with open permissions: ugo+rw Nov 05 04:08:01 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.info {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:01 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.info Nov 05 04:08:01 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:02 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.info" returned: 0 in 0.243s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:02 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-d392b4b7-c85d-4863-8ff7-ab38fc658382 tempest-ProjectMemberTests-611526917 None] Create snapshot completed successfully Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65-delete_snapshot" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Lock "cinder-debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" by "delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65" by "_delete_snapshot" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Deleting offline snapshot debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 of volume 94d4bea5-a66b-49bf-9f5c-cc16acb37d61 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] snapshot_file for this snap is: volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 {{(pid=87111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ccefe1-8fb1-4a28-baae-247fda8ed114]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:02 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 Nov 05 04:08:02 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:02 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65" returned: 0 in 0.353s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3bb35-f9d0-44e4-8975-44c6feda5c50]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:08:02 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:02 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 Nov 05 04:08:02 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:03 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" returned: 0 in 0.337s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:03 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 Nov 05 04:08:03 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:03 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65" returned: 0 in 0.322s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:03 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65 Nov 05 04:08:03 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:03 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61.debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65" returned: 0 in 0.239s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65" released by "_delete_snapshot" :: held 1.349s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" released by "delete_snapshot" :: held 1.371s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Created reservations ['e2ec2ad2-85ba-4f52-b56e-d6b240291907', 'dfac6994-a416-4398-bf89-e176731ba90c', '8c47c4d8-c23b-4c62-bf0e-665aefc00e7a', '431045a6-9233-416e-9caa-10e13c276af1'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:08:03 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Delete snapshot completed successfully. Nov 05 04:08:03 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-5140aec3-d9f9-4f7e-bc45-204d2e2df6ff tempest-ProjectMemberTests-611526917 None] Lock "cinder-debb8e7e-dc0a-47d6-a6b7-ddf9d4886b65-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-94d4bea5-a66b-49bf-9f5c-cc16acb37d61-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Lock "cinder-94d4bea5-a66b-49bf-9f5c-cc16acb37d61-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Acquiring lock "cinder-quobyte-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:04 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" acquired by "delete_volume" :: waited 0.012s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:04 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b996471d-1432-419d-af3d-24e4eebfac1b]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:08:04 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:04 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 Nov 05 04:08:04 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:05 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" returned: 0 in 0.352s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:05 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61 Nov 05 04:08:05 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:05 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" returned: 0 in 0.232s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Lock "cinder-quobyte-94d4bea5-a66b-49bf-9f5c-cc16acb37d61" released by "delete_volume" :: held 0.647s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Created reservations ['eaf05970-54b9-44b3-8336-6c96d3601435', '106719c1-02d4-4a36-ac13-a8cbb5d1aad4', '3f18199d-4a4c-49be-a4f5-ea49a2c5b26b', '02aeeeb8-7749-4fc4-adc9-2a07bd202cc4'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:05 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:08:05 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:05 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.232s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:08:05 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Deleted volume successfully. Nov 05 04:08:05 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-f10ce96d-da48-4763-b1b9-6edff095a90e tempest-ProjectMemberTests-611526917 None] Lock "cinder-94d4bea5-a66b-49bf-9f5c-cc16acb37d61-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:15 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:08:15 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=71,cinder:INSERT=21,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:08:15 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.255s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG oslo_service.periodic_task [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] Running periodic task VolumeManager._thread_info {{(pid=87111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread count: 28 {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-b1c926bd-62db-4a61-b22f-2b8b47d51f3d None None] thread info: [<_MainThread(MainThread, started 127607242551424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:08:15 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:DELETE=7,cinder:SELECT=70,cinder:INSERT=27,cinder:UPDATE=86 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Flow 'volume_create_manager' (07d4d285-6104-4a94-991a-413a162ad219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7977b5eb-1b99-4c07-a4ff-4d05a97339a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7977b5eb-1b99-4c07-a4ff-4d05a97339a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003538952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdbb3ba-146a-4556-bf19-b3566b13ae59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601afd0a7959489bae73ae77e35b0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:08:21Z,use_quota=True,user_id='80419c1a03384393a95bef757457126a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5946e94b-dd96-40c6-991c-47114be90bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5946e94b-dd96-40c6-991c-47114be90bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759f40f5-c746-4976-933c-9d90d3b2d835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759f40f5-c746-4976-933c-9d90d3b2d835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cdbb3ba-146a-4556-bf19-b3566b13ae59', 'volume_name': 'volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e3287b-de66-41ac-a7ff-990adb77fd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e3287b-de66-41ac-a7ff-990adb77fd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879ced41-33eb-498d-a709-36065852e8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:20 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Volume 2cdbb3ba-146a-4556-bf19-b3566b13ae59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59', 'volume_size': 1} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003538952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdbb3ba-146a-4556-bf19-b3566b13ae59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601afd0a7959489bae73ae77e35b0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:08:21Z,use_quota=True,user_id='80419c1a03384393a95bef757457126a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Creating volume 2cdbb3ba-146a-4556-bf19-b3566b13ae59 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:08:20 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:08:20 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:20 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 1073741824 Nov 05 04:08:20 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:21 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 1073741824" returned: 0 in 0.404s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:21 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 Nov 05 04:08:21 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:21 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59" returned: 0 in 0.234s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879ced41-33eb-498d-a709-36065852e8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67cfb65-6df2-4542-aad3-94f68f4075e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:21 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Volume volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 (2cdbb3ba-146a-4556-bf19-b3566b13ae59): created successfully Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67cfb65-6df2-4542-aad3-94f68f4075e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:21 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Flow 'volume_create_manager' (07d4d285-6104-4a94-991a-413a162ad219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:08:21 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-e20d569c-9c91-4900-93f1-b6cc79b1e63b tempest-ProjectReaderTests-422005687 None] Created volume successfully. Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Acquiring lock "cinder-2cdbb3ba-146a-4556-bf19-b3566b13ae59-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Lock "cinder-2cdbb3ba-146a-4556-bf19-b3566b13ae59-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Acquiring lock "cinder-quobyte-2cdbb3ba-146a-4556-bf19-b3566b13ae59" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Lock "cinder-quobyte-2cdbb3ba-146a-4556-bf19-b3566b13ae59" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec933a4c-31b5-4670-bb90-4f7f68ef85d6]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:22 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 Nov 05 04:08:22 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:22 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59" returned: 0 in 0.355s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:22 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59 Nov 05 04:08:22 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:22 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-2cdbb3ba-146a-4556-bf19-b3566b13ae59" returned: 0 in 0.243s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Lock "cinder-quobyte-2cdbb3ba-146a-4556-bf19-b3566b13ae59" released by "delete_volume" :: held 0.639s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Created reservations ['551ad720-7025-4d94-bace-f5a29278bf10', 'ca9ec507-9160-4796-b39e-882cb1cbd67d', '64d763c3-d582-48f1-886e-221985ad5e4f', '0128c63c-73fe-4ebd-ac5f-768d2ac9ad47'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:22 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:22 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:08:22 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:23 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.236s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:08:23 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Deleted volume successfully. Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-88b42656-61d6-40b9-bfd2-20c5158f2444 tempest-ProjectReaderTests-422005687 None] Lock "cinder-2cdbb3ba-146a-4556-bf19-b3566b13ae59-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Flow 'volume_create_manager' (b2a64279-0b78-41eb-bd85-954710842479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7acab66-902e-4721-8ab9-65d3b5adebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7acab66-902e-4721-8ab9-65d3b5adebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407005498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d44bf0-41ea-4394-9e2b-a8625e960891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601afd0a7959489bae73ae77e35b0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:08:24Z,use_quota=True,user_id='80419c1a03384393a95bef757457126a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce797f8a-279b-414c-97c8-402ebe7b42f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce797f8a-279b-414c-97c8-402ebe7b42f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1249d616-bd30-4bbc-b410-2b7ff3027f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1249d616-bd30-4bbc-b410-2b7ff3027f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d44bf0-41ea-4394-9e2b-a8625e960891', 'volume_name': 'volume-f5d44bf0-41ea-4394-9e2b-a8625e960891', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c2c40a-5167-4a41-920b-71f407f5cc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c2c40a-5167-4a41-920b-71f407f5cc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ce3ca9-a54d-48b0-bcde-4f37336736a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:23 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Volume f5d44bf0-41ea-4394-9e2b-a8625e960891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d44bf0-41ea-4394-9e2b-a8625e960891', 'volume_size': 1} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407005498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d44bf0-41ea-4394-9e2b-a8625e960891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601afd0a7959489bae73ae77e35b0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:08:24Z,use_quota=True,user_id='80419c1a03384393a95bef757457126a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Creating volume f5d44bf0-41ea-4394-9e2b-a8625e960891 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:08:23 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:08:23 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:23 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 1073741824 Nov 05 04:08:23 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:24 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 1073741824" returned: 0 in 0.403s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:24 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 Nov 05 04:08:24 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:24 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891" returned: 0 in 0.236s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ce3ca9-a54d-48b0-bcde-4f37336736a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d44bf0-41ea-4394-9e2b-a8625e960891', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d214284-cd71-45ab-8369-b51427b1f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:24 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Volume volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 (f5d44bf0-41ea-4394-9e2b-a8625e960891): created successfully Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d214284-cd71-45ab-8369-b51427b1f371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Flow 'volume_create_manager' (b2a64279-0b78-41eb-bd85-954710842479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:08:24 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-0bec76b2-4b05-4321-8e7e-55a9779df764 tempest-ProjectReaderTests-422005687 None] Created volume successfully. Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Acquiring lock "cinder-f5d44bf0-41ea-4394-9e2b-a8625e960891-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Lock "cinder-f5d44bf0-41ea-4394-9e2b-a8625e960891-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Acquiring lock "cinder-quobyte-f5d44bf0-41ea-4394-9e2b-a8625e960891" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Lock "cinder-quobyte-f5d44bf0-41ea-4394-9e2b-a8625e960891" acquired by "delete_volume" :: waited 0.013s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1925b4ac-7c2f-4605-806d-bd7af9db58db]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:08:24 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:24 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 Nov 05 04:08:24 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:25 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891" returned: 0 in 0.345s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:25 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891 Nov 05 04:08:25 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:25 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-f5d44bf0-41ea-4394-9e2b-a8625e960891" returned: 0 in 0.234s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Lock "cinder-quobyte-f5d44bf0-41ea-4394-9e2b-a8625e960891" released by "delete_volume" :: held 0.619s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Created reservations ['0621de7e-9839-475b-bbfd-fbf588684251', '9c376eff-d480-4a96-8c65-197d30f506a1', 'ee67ef48-eded-4c25-a9ec-e19d4c7e59a3', '81ed4c42-b558-48cc-8418-070c2bf62148'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:25 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:08:25 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:25 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.229s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:08:25 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Deleted volume successfully. Nov 05 04:08:25 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-31578b22-0f58-4760-8ce0-77c891e479fe tempest-ProjectReaderTests-422005687 None] Lock "cinder-f5d44bf0-41ea-4394-9e2b-a8625e960891-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Flow 'volume_create_manager' (52df4959-cd6a-46b3-81ae-f66509df682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf6c16f-40a1-4363-9823-1976eb8fd240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf6c16f-40a1-4363-9823-1976eb8fd240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093474977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4671e8d3-241f-4c01-97de-b6a7becb5f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601afd0a7959489bae73ae77e35b0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:08:26Z,use_quota=True,user_id='80419c1a03384393a95bef757457126a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40daafa-908c-456d-845b-8649bb5f7d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40daafa-908c-456d-845b-8649bb5f7d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84d22eb-a545-4d4b-a80d-12e59b92ee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84d22eb-a545-4d4b-a80d-12e59b92ee19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4671e8d3-241f-4c01-97de-b6a7becb5f64', 'volume_name': 'volume-4671e8d3-241f-4c01-97de-b6a7becb5f64', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c99d7f-fad2-4ba9-b4dd-a3cd4f590769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c99d7f-fad2-4ba9-b4dd-a3cd4f590769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf77051f-19b1-4e44-8aa2-8c9161484b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:26 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Volume 4671e8d3-241f-4c01-97de-b6a7becb5f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4671e8d3-241f-4c01-97de-b6a7becb5f64', 'volume_size': 1} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093474977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4671e8d3-241f-4c01-97de-b6a7becb5f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601afd0a7959489bae73ae77e35b0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:08:26Z,use_quota=True,user_id='80419c1a03384393a95bef757457126a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Creating volume 4671e8d3-241f-4c01-97de-b6a7becb5f64 {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:08:26 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:26 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 1073741824 Nov 05 04:08:26 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:26 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 1073741824" returned: 0 in 0.392s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:26 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:26 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 Nov 05 04:08:26 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:27 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64" returned: 0 in 0.232s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf77051f-19b1-4e44-8aa2-8c9161484b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4671e8d3-241f-4c01-97de-b6a7becb5f64', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a9f46b-71cf-4360-9b47-eb4f9ec9c156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:27 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Volume volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 (4671e8d3-241f-4c01-97de-b6a7becb5f64): created successfully Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a9f46b-71cf-4360-9b47-eb4f9ec9c156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Flow 'volume_create_manager' (52df4959-cd6a-46b3-81ae-f66509df682b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:08:27 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-8772da9e-fda7-4e84-8609-4331c0dca600 tempest-ProjectReaderTests-422005687 None] Created volume successfully. Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Acquiring lock "cinder-4671e8d3-241f-4c01-97de-b6a7becb5f64-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Lock "cinder-4671e8d3-241f-4c01-97de-b6a7becb5f64-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Acquiring lock "cinder-quobyte-4671e8d3-241f-4c01-97de-b6a7becb5f64" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Lock "cinder-quobyte-4671e8d3-241f-4c01-97de-b6a7becb5f64" acquired by "delete_volume" :: waited 0.014s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c43472-35cd-4269-b39d-d7df43fcb543]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:27 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 Nov 05 04:08:27 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:27 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64" returned: 0 in 0.348s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:27 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:27 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64 Nov 05 04:08:27 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:28 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-4671e8d3-241f-4c01-97de-b6a7becb5f64" returned: 0 in 0.245s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Lock "cinder-quobyte-4671e8d3-241f-4c01-97de-b6a7becb5f64" released by "delete_volume" :: held 0.634s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Created reservations ['a3f29d5c-13ce-482c-91ff-14e5d0016949', 'f8afc488-2e90-4281-9a1b-2185f62cb208', 'a55c5843-1456-4a10-a004-3a1c9355f0f3', 'ae911243-2976-4bf1-9a73-60dc2d147088'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:28 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:08:28 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:28 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.262s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:08:28 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Deleted volume successfully. Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-364ed96e-b76a-429c-9883-38753a9b477f tempest-ProjectReaderTests-422005687 None] Lock "cinder-4671e8d3-241f-4c01-97de-b6a7becb5f64-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Flow 'volume_create_manager' (18959751-cce9-4e10-8cb0-4f23f40a8c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdeb52b7-43f5-473a-8084-2d840060da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdeb52b7-43f5-473a-8084-2d840060da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797799346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228e028f-1019-4c59-9f95-ada5fa60750a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601afd0a7959489bae73ae77e35b0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:08:29Z,use_quota=True,user_id='80419c1a03384393a95bef757457126a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f5b58d-4a74-442d-8d8a-e66562e23f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f5b58d-4a74-442d-8d8a-e66562e23f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29bc258-1c87-4e98-983d-f909eb5ebba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29bc258-1c87-4e98-983d-f909eb5ebba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228e028f-1019-4c59-9f95-ada5fa60750a', 'volume_name': 'volume-228e028f-1019-4c59-9f95-ada5fa60750a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9e976d-5858-4b3d-afbf-352d444d04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9e976d-5858-4b3d-afbf-352d444d04de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cd08b6-fe0c-4535-a2fb-f1f38d699175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:28 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Volume 228e028f-1019-4c59-9f95-ada5fa60750a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228e028f-1019-4c59-9f95-ada5fa60750a', 'volume_size': 1} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797799346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228e028f-1019-4c59-9f95-ada5fa60750a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601afd0a7959489bae73ae77e35b0581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:08:29Z,use_quota=True,user_id='80419c1a03384393a95bef757457126a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef84332-8d8b-4cce-ab8d-fd8a80b57797),volume_type_id=1ef84332-8d8b-4cce-ab8d-fd8a80b57797)}" {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.remotefs [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Creating volume 228e028f-1019-4c59-9f95-ada5fa60750a {{(pid=87111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Selected osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 as target Quobyte volume. {{(pid=87111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:08:28 devstack cinder-volume[87111]: INFO cinder.volume.drivers.remotefs [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] casted to osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4 Nov 05 04:08:28 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a 1073741824 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:29 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a 1073741824 Nov 05 04:08:29 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:29 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a 1073741824" returned: 0 in 0.399s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:29 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a Nov 05 04:08:29 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:29 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a" returned: 0 in 0.243s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'} {{(pid=87111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cd08b6-fe0c-4535-a2fb-f1f38d699175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228e028f-1019-4c59-9f95-ada5fa60750a', 'volume_size': 1}' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae45d1b2-d0c7-4dc3-ba05-907634ebb108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:08:29 devstack cinder-volume[87111]: INFO cinder.volume.flows.manager.create_volume [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Volume volume-228e028f-1019-4c59-9f95-ada5fa60750a (228e028f-1019-4c59-9f95-ada5fa60750a): created successfully Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae45d1b2-d0c7-4dc3-ba05-907634ebb108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Flow 'volume_create_manager' (18959751-cce9-4e10-8cb0-4f23f40a8c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:08:29 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-a85b6fa0-1604-4922-bcf4-56dc89877b26 tempest-ProjectReaderTests-422005687 None] Created volume successfully. Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Acquiring lock "cinder-228e028f-1019-4c59-9f95-ada5fa60750a-delete_volume" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:29 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Lock "cinder-228e028f-1019-4c59-9f95-ada5fa60750a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Acquiring lock "cinder-quobyte-228e028f-1019-4c59-9f95-ada5fa60750a" by "delete_volume" {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Lock "cinder-quobyte-228e028f-1019-4c59-9f95-ada5fa60750a" acquired by "delete_volume" :: waited 0.012s {{(pid=87111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b6c6f6-d440-4c97-baf8-168bb14db59e]: (4, 'qcow2') {{(pid=88421) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:30 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a Nov 05 04:08:30 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:30 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a" returned: 0 in 0.362s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:30 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a Nov 05 04:08:30 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:30 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9/volume-228e028f-1019-4c59-9f95-ada5fa60750a" returned: 0 in 0.234s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Lock "cinder-quobyte-228e028f-1019-4c59-9f95-ada5fa60750a" released by "delete_volume" :: held 0.635s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG cinder.quota [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Created reservations ['ea834cdb-1cb8-4eeb-ab18-871f7295f48a', '6e0a4713-9e5b-4cf7-bce9-0df483950ff1', '72b3d726-e7d5-4816-b67e-bc35953f493b', 'af40478f-23d3-4d21-bc51-1e9e860fcf48'] {{(pid=87111) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4': None} {{(pid=87111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG cinder.volume.drivers.quobyte [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e924fe1c-9761-41c1-94f4-f36491e8f1c4'] {{(pid=87111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:08:30 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:08:30 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9 Nov 05 04:08:30 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:08:31 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Nov 05 04:08:31 devstack cinder-volume[87111]: DEBUG oslo_concurrency.processutils [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/443be39dec5d4582c0840c47668182f9" returned: 0 in 0.245s {{(pid=87111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:08:31 devstack cinder-volume[87111]: DEBUG cinder.manager [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Notifying Schedulers of capabilities ... {{(pid=87111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:08:31 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Deleted volume successfully. Nov 05 04:08:31 devstack cinder-volume[87111]: DEBUG cinder.coordination [None req-df4b4d3f-25d9-43e5-9463-cf4515d0d2d6 tempest-ProjectReaderTests-422005687 None] Lock "cinder-228e028f-1019-4c59-9f95-ada5fa60750a-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87111) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:08:40 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=31,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:08:41 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:UPDATE=47,cinder:SELECT=33,cinder:INSERT=10,cinder:DELETE=6 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}